Jun 11 14:14:22.872286 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 14:14:22.872296 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 14:14:22.872306 ip-10-0-137-224 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 14:14:22.872503 ip-10-0-137-224 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 14:14:32.920678 ip-10-0-137-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 14:14:32.920697 ip-10-0-137-224 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d2c58a59c58d46dcb8955f8ee8d84ec2 -- Jun 11 14:17:18.287363 ip-10-0-137-224 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:17:18.804165 ip-10-0-137-224 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:18.804165 ip-10-0-137-224 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:17:18.804165 ip-10-0-137-224 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:18.804165 ip-10-0-137-224 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:17:18.804165 ip-10-0-137-224 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:18.805656 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.805567 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:17:18.810656 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810630 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.810656 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810651 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.810656 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810656 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.810656 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810661 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.810656 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810665 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810670 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810674 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810677 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810681 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810685 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810689 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810692 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810696 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810699 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810703 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810706 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810710 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810714 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810718 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810722 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810726 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810730 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810734 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810737 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.810958 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810741 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810745 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810749 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810753 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810757 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810761 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810765 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810769 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810772 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810776 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810779 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810783 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810787 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810792 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810796 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810801 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810805 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810810 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810814 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810820 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.811784 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810824 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810828 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810833 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810837 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810841 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810845 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810849 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810854 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810858 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810862 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810866 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810873 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810881 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810886 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810891 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810896 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810901 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810906 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810911 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810915 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.812709 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810919 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810924 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810928 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810935 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810942 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810950 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810956 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810961 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810966 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810971 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810975 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810979 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810983 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810988 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810992 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.810997 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811001 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811005 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811010 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.813558 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811015 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811019 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811023 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811028 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811032 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811056 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811061 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811065 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811069 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811074 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811078 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811082 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811086 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811090 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811094 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.811098 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812297 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812308 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812339 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812346 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.814390 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812351 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812358 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812364 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812368 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812372 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812376 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812381 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812385 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812389 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812393 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812398 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812403 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812407 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812414 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812421 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812426 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812431 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812435 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812440 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.815246 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812444 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812448 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812452 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812456 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812461 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812466 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812471 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812475 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812480 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812484 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812488 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812493 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812497 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812502 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812506 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812511 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812515 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812519 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812524 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812528 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.815882 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812533 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812537 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812541 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812546 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812550 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812554 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812559 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812564 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812568 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812572 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812576 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812581 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812584 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812589 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812593 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812597 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812602 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812606 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812610 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812620 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.816482 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812626 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812631 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812637 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812646 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812651 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812656 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812661 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812665 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812669 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812674 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812678 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812682 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812687 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812691 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812696 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812700 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812704 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812707 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.817086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812713 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812720 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812724 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812728 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812732 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812737 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812741 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812745 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812750 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812754 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812759 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812763 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812768 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812772 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812776 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812781 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.812785 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813447 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813456 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813461 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.817769 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813465 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813470 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813474 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813478 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813483 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813488 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813494 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813499 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813503 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813507 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813511 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813515 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813520 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813526 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813531 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813536 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813540 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813544 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813549 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813553 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.818331 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813557 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813561 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813565 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813569 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813573 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813577 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813581 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813585 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813589 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813594 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813598 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813602 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813606 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813611 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813615 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813619 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813623 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813627 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813631 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813636 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.818845 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813640 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813645 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813649 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813654 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813659 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813663 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813668 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813673 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813677 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813683 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813687 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813691 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813695 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813699 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813704 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813708 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813712 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813716 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813723 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.819486 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813729 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813734 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813739 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813744 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813748 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813752 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813756 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813760 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813764 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813768 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813776 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813780 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813784 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813789 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813793 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813797 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813803 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813813 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813818 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.819951 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813822 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813829 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813834 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813838 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813843 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813847 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813851 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813855 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813860 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813864 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813868 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813872 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813876 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813880 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813884 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813888 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813892 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.813897 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814011 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814022 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814051 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:17:18.820458 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814069 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814076 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814081 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814088 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814095 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814100 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814105 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814111 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814116 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814124 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814129 2580 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814134 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814139 2580 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814145 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814150 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814157 2580 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814162 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814167 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814172 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814178 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814183 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814188 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814193 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:17:18.820960 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814199 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814204 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814209 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814214 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814219 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814224 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814231 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814236 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814240 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814245 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814251 2580 flags.go:64] FLAG: --enable-server="true" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814255 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814263 2580 flags.go:64] FLAG: --event-burst="100" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814268 2580 flags.go:64] FLAG: --event-qps="50" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814273 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814278 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814282 2580 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814289 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814296 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814301 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814306 2580 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814310 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814316 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814322 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814327 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:17:18.821532 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814331 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814336 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814341 2580 flags.go:64] FLAG: --feature-gates="" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814347 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814352 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814357 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814363 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814367 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814372 2580 flags.go:64] FLAG: --help="false" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814377 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-224.ec2.internal" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814382 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814387 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814391 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814396 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814402 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814406 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814411 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814415 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814420 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814425 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814430 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814435 2580 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814440 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814445 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:17:18.822312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814450 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814455 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814460 2580 flags.go:64] FLAG: --lock-file="" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814464 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814469 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814474 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814483 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814498 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814503 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814508 2580 flags.go:64] FLAG: --logging-format="text" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814513 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814518 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814523 2580 flags.go:64] FLAG: --manifest-url="" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814527 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814540 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814545 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814552 2580 flags.go:64] FLAG: --max-pods="110" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814557 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814562 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814567 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814571 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814576 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814580 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814585 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814598 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:17:18.822893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814603 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814608 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814613 2580 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814617 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814626 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814631 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814636 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814640 2580 flags.go:64] FLAG: --port="10250" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814646 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814655 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c87fd60008526faf" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814660 2580 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814665 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814670 2580 flags.go:64] FLAG: --register-node="true" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814675 2580 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814681 2580 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814687 2580 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814691 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814696 2580 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814702 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814707 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814712 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814717 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814722 2580 flags.go:64] FLAG: --runonce="false" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814726 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814731 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:17:18.823530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814737 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814741 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814746 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814751 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814756 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814761 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814766 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814771 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814775 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814779 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814785 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814790 2580 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814794 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814803 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814807 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814813 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814821 2580 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814826 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814831 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814835 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814840 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814845 2580 flags.go:64] FLAG: --v="2" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814851 2580 flags.go:64] FLAG: --version="false" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814859 2580 flags.go:64] FLAG: --vmodule="" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814866 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:17:18.824195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.814872 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815119 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815128 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815134 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815140 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815145 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815150 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815155 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815160 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815164 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815169 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815176 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815183 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815190 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815196 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815202 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815206 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815210 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815215 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.824824 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815219 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815224 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815228 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815232 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815240 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815244 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815248 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815252 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815256 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815261 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815265 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815269 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815274 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815279 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815283 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815287 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815292 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815296 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815301 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815305 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.825359 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815309 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815313 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815318 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815322 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815326 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815330 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815335 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815339 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815343 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815348 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815352 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815356 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815360 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815367 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815372 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815376 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815382 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815387 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815391 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815396 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.825843 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815400 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815404 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815408 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815412 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815418 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815423 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815427 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815434 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815439 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815444 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815449 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815454 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815459 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815463 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815467 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815472 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815476 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815480 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815485 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815489 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.826423 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815493 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815498 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815502 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815507 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815511 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815517 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815521 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815526 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815531 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815536 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815540 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815544 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815549 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815553 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815557 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815562 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815566 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815570 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815576 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815581 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.826922 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.815585 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.816533 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.823494 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.823602 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.823640 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.823646 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823704 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823710 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823714 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823719 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823722 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823726 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823729 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823732 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823735 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.827425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823738 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823741 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823745 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823748 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823751 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823754 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823757 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823760 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823763 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823766 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823769 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823772 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823774 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823777 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823780 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823783 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823785 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823788 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823791 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.827795 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823794 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823797 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823800 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823803 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823806 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823809 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823811 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823814 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823817 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823820 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823822 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823825 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823828 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823831 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823833 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823836 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823838 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823841 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823844 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823846 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.828277 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823849 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823851 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823855 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823857 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823860 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823864 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823867 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823870 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823873 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823876 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823879 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823881 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823884 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823887 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823890 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823893 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823896 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823898 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823901 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.828763 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823904 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823906 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823909 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823911 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823914 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823916 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823919 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823921 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823924 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823927 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823929 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823932 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823935 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823938 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823940 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823942 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823945 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823948 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823950 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823952 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.829252 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823955 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823957 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823960 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823963 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823965 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823967 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823970 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823973 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823976 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823979 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823981 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.823984 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.823989 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824120 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824126 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:18.829738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824129 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824132 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824135 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824138 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824141 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824143 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824146 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824149 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824151 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824154 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824156 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824159 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824162 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824164 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824167 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824169 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824172 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824174 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824177 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824179 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:18.830133 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824182 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824184 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824186 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824189 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824192 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824194 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824199 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824204 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824207 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824211 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824214 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824217 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824220 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824222 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824225 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824227 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824230 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824233 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824235 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824238 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:18.830614 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824240 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824243 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824245 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824248 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824250 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824253 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824255 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824258 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824260 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824263 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824265 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824268 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824270 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824273 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824275 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824278 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824281 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824283 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824286 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:18.831160 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824290 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824293 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824297 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824299 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824302 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824305 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824308 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824311 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824313 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824316 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824319 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824321 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824324 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824327 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824329 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824332 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824334 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824337 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824339 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824342 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:18.831625 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824344 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824347 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824350 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824352 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824355 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824358 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824361 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824364 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824367 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824370 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824372 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824375 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824378 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824381 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824386 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824388 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824391 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:18.832197 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:18.824393 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.824398 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.824525 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.826505 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.828453 2580 server.go:1019] "Starting client certificate rotation" Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.828556 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.828591 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:17:18.832613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.831195 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:17:18.834537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.834519 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:17:18.846196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.846176 2580 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:17:18.850307 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.850290 2580 log.go:25] "Validated CRI v1 image API" Jun 11 14:17:18.851676 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.851662 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:17:18.854769 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.854750 2580 fs.go:135] Filesystem UUIDs: map[0ad0681e-dc75-4f48-809c-faa2d0eb19d2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dbb273dc-0ffd-494e-9395-e30e85d6a5ba:/dev/nvme0n1p3] Jun 11 14:17:18.854826 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.854770 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:17:18.859932 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.859802 2580 manager.go:216] Machine: {Timestamp:2026-06-11 14:17:18.858427765 +0000 UTC m=+0.419082145 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3066044 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23306395f6e4cea8f9e74515281044 SystemUUID:ec233063-95f6-e4ce-a8f9-e74515281044 BootID:d2c58a59-c58d-46dc-b895-5f8ee8d84ec2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:fc:59:68:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:fc:59:68:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:b0:2b:bc:83:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:17:18.859932 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.859924 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:17:18.860104 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.860071 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:17:18.863227 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.863197 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:17:18.863362 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.863229 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:17:18.863987 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.863972 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:17:18.864019 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.864005 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:17:18.864019 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.864016 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:17:18.864101 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.864025 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:17:18.864792 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.864780 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:17:18.865593 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.865583 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:17:18.868286 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868275 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:17:18.868399 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868390 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:17:18.868431 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868419 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:17:18.868461 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868434 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:17:18.868461 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868444 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:17:18.868461 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868454 2580 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:17:18.868540 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868462 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:17:18.868842 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868831 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:17:18.868873 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.868855 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:17:18.871979 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.871964 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:17:18.873305 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.873291 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:17:18.873345 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.873322 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:17:18.874651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874638 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874656 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874662 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874677 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874687 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874692 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874700 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:17:18.874703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874705 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:17:18.874881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874712 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:17:18.874881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874717 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:17:18.874881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874729 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:17:18.874881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.874734 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:17:18.875538 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.875528 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:17:18.875568 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.875539 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:17:18.878765 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.878750 2580 server.go:1268] "Started kubelet" Jun 11 14:17:18.878881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.878829 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:17:18.878961 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.878899 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:17:18.879312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.878855 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:17:18.879821 ip-10-0-137-224 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:17:18.880468 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.879879 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:17:18.880468 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.879881 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:17:18.880468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.880070 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:17:18.880779 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.880627 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:17:18.883052 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.883026 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:17:18.886535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.886516 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:17:18.886535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.886522 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:17:18.886997 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.886688 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:18.887148 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887128 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:17:18.887219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887135 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:17:18.887219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887161 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:17:18.887318 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887285 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:17:18.887318 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887293 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:17:18.887544 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887526 2580 factory.go:55] Registering systemd factory Jun 11 14:17:18.887614 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.887547 2580 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:17:18.887702 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.886214 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18b80c89dcc11142 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-06-11 14:17:18.878724418 +0000 UTC m=+0.439378798,LastTimestamp:2026-06-11 14:17:18.878724418 +0000 UTC m=+0.439378798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Jun 11 14:17:18.889799 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.889724 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 14:17:18.889990 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.889965 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 14:17:18.890603 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.890584 2580 factory.go:153] Registering CRI-O factory Jun 11 14:17:18.890691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.890613 2580 factory.go:223] Registration of the crio container factory successfully Jun 11 14:17:18.890691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.890669 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:17:18.890798 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.890696 2580 factory.go:103] Registering Raw factory Jun 11 14:17:18.890798 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.890714 2580 manager.go:1196] Started watching for new ooms in manager Jun 11 14:17:18.890915 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.890884 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:17:18.891364 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.891348 2580 manager.go:349] Starting recovery of all containers Jun 11 14:17:18.900499 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.900458 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7sj5" Jun 11 14:17:18.902616 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.902588 2580 manager.go:354] Recovery completed Jun 11 14:17:18.903866 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.903842 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 14:17:18.906699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.906687 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:18.908584 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.908568 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:18.908667 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.908597 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:18.908667 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.908608 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:18.909162 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.909147 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:17:18.909162 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.909159 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:17:18.909284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.909176 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:17:18.909284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.909178 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:18.910136 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.910120 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:18.910191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.910146 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:18.910191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.910158 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:18.910191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.910162 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7sj5" Jun 11 14:17:18.911150 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.911136 2580 policy_none.go:49] "None policy: Start" Jun 11 14:17:18.911230 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.911155 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:17:18.911230 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.911172 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:17:18.911305 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.911196 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-224.ec2.internal.18b80c89de88aa19 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-224.ec2.internal,UID:ip-10-0-137-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-224.ec2.internal,},FirstTimestamp:2026-06-11 14:17:18.908582425 +0000 UTC m=+0.469236806,LastTimestamp:2026-06-11 14:17:18.908582425 +0000 UTC m=+0.469236806,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-224.ec2.internal,}" Jun 11 14:17:18.912212 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.912200 2580 policy_none.go:47] "Start" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.950635 2580 manager.go:337] "Starting Device Plugin manager" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.950707 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.950722 2580 server.go:87] "Starting device plugin registration server" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.950930 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.950970 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.950980 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.951131 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.951214 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.951227 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.952244 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.952298 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.952531 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.952564 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.952582 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:17:18.953710 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:18.952613 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:17:18.954835 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:18.954802 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:19.051808 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.051770 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:19.053118 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053088 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal"] Jun 11 14:17:19.053205 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053159 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:19.053815 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053788 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053826 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053827 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053838 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053849 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053861 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:19.053903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.053880 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.055057 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055009 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:19.055212 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.055255 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055230 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:19.055779 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055761 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:19.055862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055787 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:19.055862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055811 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:19.055862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055815 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:19.055862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055822 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:19.055862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.055826 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:19.057026 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.057011 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.057088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.057052 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:19.057747 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.057731 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:19.057819 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.057762 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:19.057819 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.057777 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:19.062139 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.062120 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.062215 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.062145 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-224.ec2.internal\": node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.079483 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.079459 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.087685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.087658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.087808 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.087691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.087808 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.087709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a14bb7d8ac0382fb9d1d5bb6274cccb3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"a14bb7d8ac0382fb9d1d5bb6274cccb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.087808 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.087768 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-224.ec2.internal\" not found" node="ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.092191 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.092175 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-224.ec2.internal\" not found" node="ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.179969 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.179933 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.188787 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.188859 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.188859 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a14bb7d8ac0382fb9d1d5bb6274cccb3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"a14bb7d8ac0382fb9d1d5bb6274cccb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.188859 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188849 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a14bb7d8ac0382fb9d1d5bb6274cccb3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-224.ec2.internal\" (UID: \"a14bb7d8ac0382fb9d1d5bb6274cccb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.188964 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188859 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.188964 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.188873 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a14ca04591f6e861fc1c1e2e13c075f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal\" (UID: \"1a14ca04591f6e861fc1c1e2e13c075f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.280074 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.280008 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.380825 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.380762 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.391206 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.391187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.396736 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.396718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:19.481171 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.481130 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.581648 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.581621 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.682186 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.682108 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.782645 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.782607 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.827115 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.827089 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:17:19.827658 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.827260 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:17:19.884008 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.883975 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:19.912900 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.912864 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:12:18 +0000 UTC" deadline="2028-03-10 03:34:52.896699942 +0000 UTC" Jun 11 14:17:19.913050 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.912914 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15301h17m32.983808584s" Jun 11 14:17:19.933738 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:19.933676 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14bb7d8ac0382fb9d1d5bb6274cccb3.slice/crio-64b5c90d9f27b1680e200474a5174b19394337436aa8d59921f45bfe3e762401 WatchSource:0}: Error finding container 64b5c90d9f27b1680e200474a5174b19394337436aa8d59921f45bfe3e762401: Status 404 returned error can't find the container with id 64b5c90d9f27b1680e200474a5174b19394337436aa8d59921f45bfe3e762401 Jun 11 14:17:19.934149 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:19.934110 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a14ca04591f6e861fc1c1e2e13c075f.slice/crio-5151c578dc80c6e2f827e02ea41579ed7d17a992986595e13edd047a51c1607d WatchSource:0}: Error finding container 5151c578dc80c6e2f827e02ea41579ed7d17a992986595e13edd047a51c1607d: Status 404 returned error can't find the container with id 5151c578dc80c6e2f827e02ea41579ed7d17a992986595e13edd047a51c1607d Jun 11 14:17:19.938605 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.938585 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:17:19.943834 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.943813 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:19.956052 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.955993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"1a14ca04591f6e861fc1c1e2e13c075f","Type":"ContainerStarted","Data":"5151c578dc80c6e2f827e02ea41579ed7d17a992986595e13edd047a51c1607d"} Jun 11 14:17:19.957053 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:19.957010 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" event={"ID":"a14bb7d8ac0382fb9d1d5bb6274cccb3","Type":"ContainerStarted","Data":"64b5c90d9f27b1680e200474a5174b19394337436aa8d59921f45bfe3e762401"} Jun 11 14:17:19.984129 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:19.984103 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-224.ec2.internal\" not found" Jun 11 14:17:20.059163 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.059134 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:20.087006 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.086982 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" Jun 11 14:17:20.101818 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.101794 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:17:20.103075 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.103058 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" Jun 11 14:17:20.111484 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.111464 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:17:20.471332 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.471301 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:20.652426 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.652394 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:20.869585 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.869550 2580 apiserver.go:52] "Watching apiserver" Jun 11 14:17:20.875462 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.875439 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:17:20.875871 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.875848 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-5pv28","kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sk76g","openshift-dns/node-resolver-dm2zr","openshift-multus/multus-additional-cni-plugins-h8zrq","openshift-multus/network-metrics-daemon-zq856","openshift-ovn-kubernetes/ovnkube-node-cg9v5","kube-system/global-pull-secret-syncer-mtmtn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc","openshift-image-registry/node-ca-nsjmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal","openshift-multus/multus-gwrws","openshift-network-diagnostics/network-check-target-q6qdj","openshift-network-operator/iptables-alerter-l7nmx"] Jun 11 14:17:20.877438 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.877418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.878712 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.878693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:20.878805 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:20.878753 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:20.879565 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:17:20.880116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879732 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:17:20.880116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879828 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:17:20.880116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879888 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.880116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.880116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.879964 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.880384 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.880270 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:17:20.880384 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.880315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gfdjm\"" Jun 11 14:17:20.881430 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.881412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:20.882617 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.882595 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2ch7l\"" Jun 11 14:17:20.882916 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.882893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.883007 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.882943 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.884176 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.884114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.885651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.885628 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.885811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.885791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftc9j\"" Jun 11 14:17:20.886112 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.885994 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.886481 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.886246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:17:20.886481 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.886292 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.886656 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.886464 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.886584 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:20.887237 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.887358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.887048 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.887495 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bqv77\"" Jun 11 14:17:20.887537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.887535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:17:20.888776 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.888748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.890133 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.890114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:20.890784 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.890763 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:17:20.890867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.890774 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.890867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.890833 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mw2mq\"" Jun 11 14:17:20.890867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.890844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.891899 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.891817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:20.892155 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.892034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6lnf\"" Jun 11 14:17:20.892353 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.892336 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:17:20.892523 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.892505 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:17:20.893464 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.893447 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:20.894052 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.893885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c97gf\"" Jun 11 14:17:20.894052 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.893921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.894189 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.894153 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:17:20.894246 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.894201 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.895435 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.895417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:17:20.895580 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.895562 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:20.895670 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:20.895647 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:20.896136 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.896117 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:17:20.896219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.896165 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:17:20.896219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.896198 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w4zcb\"" Jun 11 14:17:20.897080 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.897015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwrws" Jun 11 14:17:20.898586 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-config\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.898677 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vw2\" (UniqueName: \"kubernetes.io/projected/8f81b9a0-1c04-4221-9cab-437f0066c3a3-kube-api-access-s7vw2\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.898677 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-host\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.898677 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-etc-tuned\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.898677 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-kubelet\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-systemd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysconfig\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-tmp\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-script-lib\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-tmp-dir\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898897 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlxn\" (UniqueName: \"kubernetes.io/projected/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-kube-api-access-htlxn\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898924 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.898976 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-registration-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.898997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-log-socket\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-systemd\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-hosts-file\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-kubernetes\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899168 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qt2bg\"" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-conf\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqxv\" (UniqueName: \"kubernetes.io/projected/70750422-8658-4523-9abf-f29bcda437bb-kube-api-access-gvqxv\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-sys-fs\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-bin\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-netd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-sys\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-var-lib-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.899495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-env-overrides\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-socket-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-var-lib-kubelet\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq6rr\" (UniqueName: \"kubernetes.io/projected/d5b54f23-835a-49a0-be44-c01200150da7-kube-api-access-kq6rr\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-device-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-netns\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-etc-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-node-log\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-modprobe-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-cnibin\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-systemd-units\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-ovn\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh6ql\" (UniqueName: \"kubernetes.io/projected/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-kube-api-access-nh6ql\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:20.900119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-run\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-system-cni-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccnd\" (UniqueName: \"kubernetes.io/projected/319cffac-f541-4d8a-b0ce-51aa8f15b191-kube-api-access-9ccnd\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-slash\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.899999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.900016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-lib-modules\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.900030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-os-release\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:20.900794 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.900073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:20.920324 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.920303 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tkm7" Jun 11 14:17:20.929601 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.929460 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tkm7" Jun 11 14:17:20.988076 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:20.988025 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:17:21.001261 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-modprobe-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-cnibin\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-systemd-units\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-ovn\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001358 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-cnibin\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-kubelet\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.001405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001348 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-systemd-units\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-daemon-config\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001416 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-ovn\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/93f33bc1-a5ea-4261-b31e-9c9f17051f73-kube-api-access-ll5w4\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-modprobe-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh6ql\" (UniqueName: \"kubernetes.io/projected/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-kube-api-access-nh6ql\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:21.001686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.001747 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-k8s-cni-cncf-io\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-run\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.001836 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:21.501798482 +0000 UTC m=+3.062452853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-run\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-system-cni-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccnd\" (UniqueName: \"kubernetes.io/projected/319cffac-f541-4d8a-b0ce-51aa8f15b191-kube-api-access-9ccnd\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-slash\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001933 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-system-cni-dir\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85c2f4f6-51a1-409a-8d62-cfe509b509c9-host-slash\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001982 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-slash\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.001997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-etc-kubernetes\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sb9c\" (UniqueName: \"kubernetes.io/projected/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-kube-api-access-8sb9c\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-netns\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-lib-modules\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-os-release\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-config\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vw2\" (UniqueName: \"kubernetes.io/projected/8f81b9a0-1c04-4221-9cab-437f0066c3a3-kube-api-access-s7vw2\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002215 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-lib-modules\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002219 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5b54f23-835a-49a0-be44-c01200150da7-os-release\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-host\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-host\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-etc-tuned\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-kubelet\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002326 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002325 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-systemd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002402 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-kubelet\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-run-systemd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-conf-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d243aae0-e87b-474e-82f3-afd4976ee533-agent-certs\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.002920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d243aae0-e87b-474e-82f3-afd4976ee533-konnectivity-ca\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-serviceca\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-socket-dir-parent\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-hostroot\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysconfig\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-tmp\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002630 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-script-lib\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-tmp-dir\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlxn\" (UniqueName: \"kubernetes.io/projected/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-kube-api-access-htlxn\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-registration-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-log-socket\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-dbus\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.003685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-systemd\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85c2f4f6-51a1-409a-8d62-cfe509b509c9-iptables-alerter-script\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002851 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-config\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-os-release\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-multus-certs\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-hosts-file\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-kubernetes\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-registration-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-conf\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqxv\" (UniqueName: \"kubernetes.io/projected/70750422-8658-4523-9abf-f29bcda437bb-kube-api-access-gvqxv\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.002975 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-tmp-dir\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-log-socket\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-sys-fs\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003242 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.004468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-bin\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-bin\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-netd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003326 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-sys-fs\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-host\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovnkube-script-lib\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysconfig\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-hosts-file\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-sys\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-var-lib-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-d\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-system-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-cni-netd\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-sysctl-conf\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003595 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-sys\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003630 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-systemd\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.005224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cni-binary-copy\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-bin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-var-lib-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-multus\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-env-overrides\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-socket-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-var-lib-kubelet\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.003990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq6rr\" (UniqueName: \"kubernetes.io/projected/d5b54f23-835a-49a0-be44-c01200150da7-kube-api-access-kq6rr\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-var-lib-kubelet\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004077 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004083 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5b54f23-835a-49a0-be44-c01200150da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-device-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-socket-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70750422-8658-4523-9abf-f29bcda437bb-etc-kubernetes\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-kubelet-config\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004128 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/319cffac-f541-4d8a-b0ce-51aa8f15b191-device-dir\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.006096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f81b9a0-1c04-4221-9cab-437f0066c3a3-env-overrides\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004222 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-netns\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-etc-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004325 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-etc-openvswitch\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-node-log\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-host-run-netns\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7588\" (UniqueName: \"kubernetes.io/projected/85c2f4f6-51a1-409a-8d62-cfe509b509c9-kube-api-access-h7588\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cnibin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.004428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f81b9a0-1c04-4221-9cab-437f0066c3a3-node-log\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.006525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-tmp\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.006785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.006572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f81b9a0-1c04-4221-9cab-437f0066c3a3-ovn-node-metrics-cert\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.007104 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.006796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70750422-8658-4523-9abf-f29bcda437bb-etc-tuned\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.008822 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.008637 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:21.008822 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.008685 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:21.008822 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.008699 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:21.008822 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.008761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:21.50874505 +0000 UTC m=+3.069399422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:21.010723 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.010636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh6ql\" (UniqueName: \"kubernetes.io/projected/32a1d6ee-a64c-40eb-aaca-44a2ed3daef3-kube-api-access-nh6ql\") pod \"node-resolver-dm2zr\" (UID: \"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3\") " pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.010723 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.010641 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vw2\" (UniqueName: \"kubernetes.io/projected/8f81b9a0-1c04-4221-9cab-437f0066c3a3-kube-api-access-s7vw2\") pod \"ovnkube-node-cg9v5\" (UID: \"8f81b9a0-1c04-4221-9cab-437f0066c3a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.011546 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.011509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccnd\" (UniqueName: \"kubernetes.io/projected/319cffac-f541-4d8a-b0ce-51aa8f15b191-kube-api-access-9ccnd\") pod \"aws-ebs-csi-driver-node-hbbxc\" (UID: \"319cffac-f541-4d8a-b0ce-51aa8f15b191\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.012031 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.012014 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq6rr\" (UniqueName: \"kubernetes.io/projected/d5b54f23-835a-49a0-be44-c01200150da7-kube-api-access-kq6rr\") pod \"multus-additional-cni-plugins-h8zrq\" (UID: \"d5b54f23-835a-49a0-be44-c01200150da7\") " pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.012246 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.012230 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqxv\" (UniqueName: \"kubernetes.io/projected/70750422-8658-4523-9abf-f29bcda437bb-kube-api-access-gvqxv\") pod \"tuned-sk76g\" (UID: \"70750422-8658-4523-9abf-f29bcda437bb\") " pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.012392 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.012372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlxn\" (UniqueName: \"kubernetes.io/projected/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-kube-api-access-htlxn\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:21.105266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7588\" (UniqueName: \"kubernetes.io/projected/85c2f4f6-51a1-409a-8d62-cfe509b509c9-kube-api-access-h7588\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.105266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cnibin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-kubelet\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-daemon-config\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/93f33bc1-a5ea-4261-b31e-9c9f17051f73-kube-api-access-ll5w4\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105327 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cnibin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-k8s-cni-cncf-io\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105390 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85c2f4f6-51a1-409a-8d62-cfe509b509c9-host-slash\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-kubelet\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-etc-kubernetes\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sb9c\" (UniqueName: \"kubernetes.io/projected/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-kube-api-access-8sb9c\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-k8s-cni-cncf-io\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-netns\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-etc-kubernetes\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-conf-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d243aae0-e87b-474e-82f3-afd4976ee533-agent-certs\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-conf-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d243aae0-e87b-474e-82f3-afd4976ee533-konnectivity-ca\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-serviceca\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105606 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85c2f4f6-51a1-409a-8d62-cfe509b509c9-host-slash\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.105629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-socket-dir-parent\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-hostroot\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-socket-dir-parent\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-netns\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-dbus\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85c2f4f6-51a1-409a-8d62-cfe509b509c9-iptables-alerter-script\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-hostroot\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-os-release\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-multus-certs\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-host\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105857 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-run-multus-certs\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105864 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-multus-daemon-config\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-host\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-system-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-dbus\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cni-binary-copy\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.106380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.105953 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.105975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-bin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-multus\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.106018 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:21.606000266 +0000 UTC m=+3.166654651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106052 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-multus\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-kubelet-config\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106089 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-host-var-lib-cni-bin\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106166 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-system-cni-dir\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-serviceca\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-kubelet-config\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d243aae0-e87b-474e-82f3-afd4976ee533-konnectivity-ca\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f33bc1-a5ea-4261-b31e-9c9f17051f73-os-release\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106405 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f33bc1-a5ea-4261-b31e-9c9f17051f73-cni-binary-copy\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.107272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.106442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85c2f4f6-51a1-409a-8d62-cfe509b509c9-iptables-alerter-script\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.108212 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.108195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d243aae0-e87b-474e-82f3-afd4976ee533-agent-certs\") pod \"konnectivity-agent-5pv28\" (UID: \"d243aae0-e87b-474e-82f3-afd4976ee533\") " pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.113915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.113895 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5w4\" (UniqueName: \"kubernetes.io/projected/93f33bc1-a5ea-4261-b31e-9c9f17051f73-kube-api-access-ll5w4\") pod \"multus-gwrws\" (UID: \"93f33bc1-a5ea-4261-b31e-9c9f17051f73\") " pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.114090 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.114070 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7588\" (UniqueName: \"kubernetes.io/projected/85c2f4f6-51a1-409a-8d62-cfe509b509c9-kube-api-access-h7588\") pod \"iptables-alerter-l7nmx\" (UID: \"85c2f4f6-51a1-409a-8d62-cfe509b509c9\") " pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.114129 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.114073 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sb9c\" (UniqueName: \"kubernetes.io/projected/0a7d6e05-4f94-4bfe-974f-d29eb0acbead-kube-api-access-8sb9c\") pod \"node-ca-nsjmk\" (UID: \"0a7d6e05-4f94-4bfe-974f-d29eb0acbead\") " pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.191161 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.191126 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:21.198151 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.198127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sk76g" Jun 11 14:17:21.207684 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.207665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dm2zr" Jun 11 14:17:21.213337 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.213319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" Jun 11 14:17:21.219806 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.219786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" Jun 11 14:17:21.226322 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.226299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:21.234096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.234074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7nmx" Jun 11 14:17:21.242678 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.242659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nsjmk" Jun 11 14:17:21.248142 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.248126 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwrws" Jun 11 14:17:21.508392 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.508324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:21.508513 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.508424 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:21.508513 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.508472 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:22.508459507 +0000 UTC m=+4.069113874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:21.609167 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.609137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:21.609167 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.609177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:21.609380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609302 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:21.609380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609316 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:21.609380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609335 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:21.609380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609348 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:21.609380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609373 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:22.609353207 +0000 UTC m=+4.170007588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:21.609556 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:21.609396 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:22.609380699 +0000 UTC m=+4.170035065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:21.759292 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.759250 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd243aae0_e87b_474e_82f3_afd4976ee533.slice/crio-a951ce302c530c263d9527861f57be63ea3db6515c8479b3f6683bf9a84c9718 WatchSource:0}: Error finding container a951ce302c530c263d9527861f57be63ea3db6515c8479b3f6683bf9a84c9718: Status 404 returned error can't find the container with id a951ce302c530c263d9527861f57be63ea3db6515c8479b3f6683bf9a84c9718 Jun 11 14:17:21.760139 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.760078 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b54f23_835a_49a0_be44_c01200150da7.slice/crio-41d1ec90ca23380ff25fbb71bf1a54fdfabf28d750f20485bfa3dd1d6aa511ef WatchSource:0}: Error finding container 41d1ec90ca23380ff25fbb71bf1a54fdfabf28d750f20485bfa3dd1d6aa511ef: Status 404 returned error can't find the container with id 41d1ec90ca23380ff25fbb71bf1a54fdfabf28d750f20485bfa3dd1d6aa511ef Jun 11 14:17:21.763506 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.763423 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7d6e05_4f94_4bfe_974f_d29eb0acbead.slice/crio-3904f4ad557a34c7d1f9ffa6e9310760539b17b3d9f87323b3ae458ca94d20b8 WatchSource:0}: Error finding container 3904f4ad557a34c7d1f9ffa6e9310760539b17b3d9f87323b3ae458ca94d20b8: Status 404 returned error can't find the container with id 3904f4ad557a34c7d1f9ffa6e9310760539b17b3d9f87323b3ae458ca94d20b8 Jun 11 14:17:21.765076 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.765009 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a1d6ee_a64c_40eb_aaca_44a2ed3daef3.slice/crio-43f5147fae5857571cfda0bf0863a10cf8d1b1e1788beeb836a551f591f4b3d4 WatchSource:0}: Error finding container 43f5147fae5857571cfda0bf0863a10cf8d1b1e1788beeb836a551f591f4b3d4: Status 404 returned error can't find the container with id 43f5147fae5857571cfda0bf0863a10cf8d1b1e1788beeb836a551f591f4b3d4 Jun 11 14:17:21.765883 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.765863 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70750422_8658_4523_9abf_f29bcda437bb.slice/crio-28920f9b7fd7600a5fe98106f3302f191b8897dd70b33488e445f4a16e8a1322 WatchSource:0}: Error finding container 28920f9b7fd7600a5fe98106f3302f191b8897dd70b33488e445f4a16e8a1322: Status 404 returned error can't find the container with id 28920f9b7fd7600a5fe98106f3302f191b8897dd70b33488e445f4a16e8a1322 Jun 11 14:17:21.767818 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.767792 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f81b9a0_1c04_4221_9cab_437f0066c3a3.slice/crio-68548099e23a1787e5a0c3b2073a9ad8adf32027476ab2ca36e116e693165a20 WatchSource:0}: Error finding container 68548099e23a1787e5a0c3b2073a9ad8adf32027476ab2ca36e116e693165a20: Status 404 returned error can't find the container with id 68548099e23a1787e5a0c3b2073a9ad8adf32027476ab2ca36e116e693165a20 Jun 11 14:17:21.771316 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.769944 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c2f4f6_51a1_409a_8d62_cfe509b509c9.slice/crio-c6d6035172eac5882e3894b479ab85e79e49df5079fb7a8c79e172142535cc8e WatchSource:0}: Error finding container c6d6035172eac5882e3894b479ab85e79e49df5079fb7a8c79e172142535cc8e: Status 404 returned error can't find the container with id c6d6035172eac5882e3894b479ab85e79e49df5079fb7a8c79e172142535cc8e Jun 11 14:17:21.771316 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.770756 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f33bc1_a5ea_4261_b31e_9c9f17051f73.slice/crio-eb170f7c7ffe90bc22ffc92b702f17f5724bd5885149c63df07276ebb9cc0149 WatchSource:0}: Error finding container eb170f7c7ffe90bc22ffc92b702f17f5724bd5885149c63df07276ebb9cc0149: Status 404 returned error can't find the container with id eb170f7c7ffe90bc22ffc92b702f17f5724bd5885149c63df07276ebb9cc0149 Jun 11 14:17:21.772154 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:21.772023 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319cffac_f541_4d8a_b0ce_51aa8f15b191.slice/crio-cf3a85075bc44d0e67e88e2cbd969f3690fae072988322e7bfc5a09d0c87f77b WatchSource:0}: Error finding container cf3a85075bc44d0e67e88e2cbd969f3690fae072988322e7bfc5a09d0c87f77b: Status 404 returned error can't find the container with id cf3a85075bc44d0e67e88e2cbd969f3690fae072988322e7bfc5a09d0c87f77b Jun 11 14:17:21.931799 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.931728 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:12:20 +0000 UTC" deadline="2028-03-20 15:06:55.561772436 +0000 UTC" Jun 11 14:17:21.931799 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.931789 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15552h49m33.629985961s" Jun 11 14:17:21.961754 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.961721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" event={"ID":"319cffac-f541-4d8a-b0ce-51aa8f15b191","Type":"ContainerStarted","Data":"cf3a85075bc44d0e67e88e2cbd969f3690fae072988322e7bfc5a09d0c87f77b"} Jun 11 14:17:21.962882 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.962856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwrws" event={"ID":"93f33bc1-a5ea-4261-b31e-9c9f17051f73","Type":"ContainerStarted","Data":"eb170f7c7ffe90bc22ffc92b702f17f5724bd5885149c63df07276ebb9cc0149"} Jun 11 14:17:21.963982 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.963958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"68548099e23a1787e5a0c3b2073a9ad8adf32027476ab2ca36e116e693165a20"} Jun 11 14:17:21.965498 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.965471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm2zr" event={"ID":"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3","Type":"ContainerStarted","Data":"43f5147fae5857571cfda0bf0863a10cf8d1b1e1788beeb836a551f591f4b3d4"} Jun 11 14:17:21.966681 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.966653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerStarted","Data":"41d1ec90ca23380ff25fbb71bf1a54fdfabf28d750f20485bfa3dd1d6aa511ef"} Jun 11 14:17:21.971129 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.971106 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" event={"ID":"a14bb7d8ac0382fb9d1d5bb6274cccb3","Type":"ContainerStarted","Data":"c939f94173ca721e2a64c8669057e71ee227fb71051c7b9960c438979070f0a0"} Jun 11 14:17:21.972310 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.972286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7nmx" event={"ID":"85c2f4f6-51a1-409a-8d62-cfe509b509c9","Type":"ContainerStarted","Data":"c6d6035172eac5882e3894b479ab85e79e49df5079fb7a8c79e172142535cc8e"} Jun 11 14:17:21.973417 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.973390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sk76g" event={"ID":"70750422-8658-4523-9abf-f29bcda437bb","Type":"ContainerStarted","Data":"28920f9b7fd7600a5fe98106f3302f191b8897dd70b33488e445f4a16e8a1322"} Jun 11 14:17:21.974554 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.974519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nsjmk" event={"ID":"0a7d6e05-4f94-4bfe-974f-d29eb0acbead","Type":"ContainerStarted","Data":"3904f4ad557a34c7d1f9ffa6e9310760539b17b3d9f87323b3ae458ca94d20b8"} Jun 11 14:17:21.975441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.975424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pv28" event={"ID":"d243aae0-e87b-474e-82f3-afd4976ee533","Type":"ContainerStarted","Data":"a951ce302c530c263d9527861f57be63ea3db6515c8479b3f6683bf9a84c9718"} Jun 11 14:17:21.983823 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:21.983786 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-224.ec2.internal" podStartSLOduration=1.9837748149999999 podStartE2EDuration="1.983774815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:21.983676439 +0000 UTC m=+3.544330828" watchObservedRunningTime="2026-06-11 14:17:21.983774815 +0000 UTC m=+3.544429201" Jun 11 14:17:22.518728 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.518167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:22.518728 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.518314 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:22.518728 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.518378 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:24.51835878 +0000 UTC m=+6.079013150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.619203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.619275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.619447 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.619466 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.619478 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.619566 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:24.61951876 +0000 UTC m=+6.180173142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.619951 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:22.620069 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.620001 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:24.619987158 +0000 UTC m=+6.180641531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:22.932736 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.932591 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:12:20 +0000 UTC" deadline="2028-01-16 02:48:22.8109598 +0000 UTC" Jun 11 14:17:22.932736 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.932655 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14004h30m59.878308568s" Jun 11 14:17:22.954267 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.953538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:22.954267 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.953672 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:22.954267 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.954105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:22.954267 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.954210 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:22.954803 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.954671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:22.954803 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:22.954770 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:22.990031 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.988859 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a14ca04591f6e861fc1c1e2e13c075f" containerID="5c39820c55f1861b09864f2003650d72657ccadc13c00594cd22aaf0f83a40fd" exitCode=0 Jun 11 14:17:22.990031 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:22.989820 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"1a14ca04591f6e861fc1c1e2e13c075f","Type":"ContainerDied","Data":"5c39820c55f1861b09864f2003650d72657ccadc13c00594cd22aaf0f83a40fd"} Jun 11 14:17:24.007445 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.007406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" event={"ID":"1a14ca04591f6e861fc1c1e2e13c075f","Type":"ContainerStarted","Data":"f715c139f4aef1d8278d8067268aef30fe85cb75dc431265ab9618ca8e947dad"} Jun 11 14:17:24.537077 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.537014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:24.537256 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.537187 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:24.537256 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.537249 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:28.537231851 +0000 UTC m=+10.097886231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.638169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.638227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638394 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638416 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638429 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638486 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:28.638469055 +0000 UTC m=+10.199123435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638866 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:24.638958 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.638911 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:28.638896438 +0000 UTC m=+10.199550806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.955205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.955237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.955351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:24.955205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.955467 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:24.955935 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:24.955888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:26.953797 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:26.953765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:26.954251 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:26.953765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:26.954251 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:26.953899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:26.954251 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:26.953908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:26.954251 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:26.953980 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:26.954251 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:26.954094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:28.572700 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.572658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:28.573216 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.572814 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:28.573216 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.572893 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:36.572871206 +0000 UTC m=+18.133525606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.673467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.673566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673687 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673747 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:36.673729799 +0000 UTC m=+18.234384175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673835 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673849 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673862 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:28.674246 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.673896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:36.673884573 +0000 UTC m=+18.234538944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.954003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.954129 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.954008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.954279 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:28.954479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:28.954856 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:28.954562 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:30.953405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:30.953153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:30.953839 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:30.953235 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:30.953839 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:30.953508 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:30.953839 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:30.953590 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:30.953839 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:30.953236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:30.953839 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:30.953679 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:32.953858 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:32.953822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:32.954314 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:32.953822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:32.954314 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:32.953965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:32.954314 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:32.953989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:32.954314 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:32.954084 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:32.954314 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:32.954155 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:34.953589 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:34.953558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:34.953589 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:34.953588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:34.954124 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:34.953557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:34.954124 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:34.953683 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:34.954124 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:34.953732 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:34.954124 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:34.953856 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:36.631860 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.631825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:36.632279 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.631964 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:36.632279 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.632016 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:17:52.632001751 +0000 UTC m=+34.192656118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:36.732192 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.732149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:36.732192 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.732199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:36.732363 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732311 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:36.732363 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732342 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:36.732363 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732354 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:36.732363 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732363 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:36.732495 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732383 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:52.732365161 +0000 UTC m=+34.293019527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:36.732495 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.732407 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:52.732395599 +0000 UTC m=+34.293049966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:36.953081 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.952975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:36.953081 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.952977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:36.953081 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:36.953051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:36.953338 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.953137 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:36.953338 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.953220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:36.953338 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:36.953311 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:38.953654 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:38.953621 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:38.954180 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:38.953718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:38.954180 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:38.953740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:38.954180 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:38.953855 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:38.954180 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:38.953914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:38.954180 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:38.953984 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:40.953964 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:40.953776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:40.954813 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:40.953791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:40.954813 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:40.954060 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:40.954813 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:40.954115 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:40.954813 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:40.953843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:40.954813 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:40.954187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:41.043382 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.043340 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nsjmk" event={"ID":"0a7d6e05-4f94-4bfe-974f-d29eb0acbead","Type":"ContainerStarted","Data":"3c671831b28f0a9bd6752bdcae297ec935364f3e74c515eec6dd1a6eca71221e"} Jun 11 14:17:41.044911 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.044880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pv28" event={"ID":"d243aae0-e87b-474e-82f3-afd4976ee533","Type":"ContainerStarted","Data":"66fc9f826a4fb3b871fa0ee299d210012485672bb090ed06c4172f496c1b63cf"} Jun 11 14:17:41.046440 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.046410 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" event={"ID":"319cffac-f541-4d8a-b0ce-51aa8f15b191","Type":"ContainerStarted","Data":"259d3c9e0958993e959c5a336674bd112fe3b862f5d8d6575dec8b3fa2f541ef"} Jun 11 14:17:41.047937 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.047911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwrws" event={"ID":"93f33bc1-a5ea-4261-b31e-9c9f17051f73","Type":"ContainerStarted","Data":"321f85131a1d9762181724ba1d7cc177fe51b1006ba66631e7caadfbfb8e81fb"} Jun 11 14:17:41.049288 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.049261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dm2zr" event={"ID":"32a1d6ee-a64c-40eb-aaca-44a2ed3daef3","Type":"ContainerStarted","Data":"4b67140efa2f04cd46689d65abf791ad0e9170fe9e5b4d4f3ce12b77e2efe81e"} Jun 11 14:17:41.050762 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.050740 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="5ba2a9341e893b2f1152c971846980ef75fa4995570924a2accc15ec57d6c970" exitCode=0 Jun 11 14:17:41.050828 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.050802 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"5ba2a9341e893b2f1152c971846980ef75fa4995570924a2accc15ec57d6c970"} Jun 11 14:17:41.052203 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.052172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sk76g" event={"ID":"70750422-8658-4523-9abf-f29bcda437bb","Type":"ContainerStarted","Data":"89a693cb970404648cdceb487967f863a40883abedadb0e87fae3a126903fb90"} Jun 11 14:17:41.057528 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.057491 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nsjmk" podStartSLOduration=3.237594606 podStartE2EDuration="22.057474549s" totalImagesPullingTime="18.819879943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.05687186 +0000 UTC m=+22.617526256" watchObservedRunningTime="2026-06-11 14:17:41.057474549 +0000 UTC m=+22.618128957" Jun 11 14:17:41.057658 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.057557 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-224.ec2.internal" podStartSLOduration=21.057551858 podStartE2EDuration="21.057551858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:24.022585223 +0000 UTC m=+5.583239613" watchObservedRunningTime="2026-06-11 14:17:41.057551858 +0000 UTC m=+22.618206246" Jun 11 14:17:41.071217 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.071083 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dm2zr" podStartSLOduration=3.239643524 podStartE2EDuration="22.071065824s" totalImagesPullingTime="18.8314223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.070420526 +0000 UTC m=+22.631074916" watchObservedRunningTime="2026-06-11 14:17:41.071065824 +0000 UTC m=+22.631720213" Jun 11 14:17:41.107103 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.107034 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5pv28" podStartSLOduration=3.312607444 podStartE2EDuration="22.107019161s" totalImagesPullingTime="18.794411717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.107001883 +0000 UTC m=+22.667656271" watchObservedRunningTime="2026-06-11 14:17:41.107019161 +0000 UTC m=+22.667673550" Jun 11 14:17:41.135924 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.135866 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gwrws" podStartSLOduration=3.052334599 podStartE2EDuration="22.135846853s" totalImagesPullingTime="19.083512254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.135642265 +0000 UTC m=+22.696296645" watchObservedRunningTime="2026-06-11 14:17:41.135846853 +0000 UTC m=+22.696501245" Jun 11 14:17:41.166143 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.166024 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sk76g" podStartSLOduration=3.333551847 podStartE2EDuration="22.166003498s" totalImagesPullingTime="18.832451651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.162366661 +0000 UTC m=+22.723021049" watchObservedRunningTime="2026-06-11 14:17:41.166003498 +0000 UTC m=+22.726657889" Jun 11 14:17:41.171262 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.171232 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:41.316657 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.315811 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:41.416308 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.416282 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:41.503927 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.503893 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:41.619582 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.619557 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:41.720326 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:41.720299 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:42.058969 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.058752 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:17:42.059485 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.059460 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f81b9a0-1c04-4221-9cab-437f0066c3a3" containerID="dfb37f9cbce5fd7e8608a5f42bb4d9fa856aa731edce3c907feda4080d149bed" exitCode=1 Jun 11 14:17:42.059580 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.059555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"02139fb71000da8ddbfdadca84605f1f2b882f03ec5972d0cbd7f425b75c43a8"} Jun 11 14:17:42.059711 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.059693 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"e04f4db43900e2321f2e5fb259e6223889c0061f7c70d67065ac737fb9775f66"} Jun 11 14:17:42.059793 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.059753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerDied","Data":"dfb37f9cbce5fd7e8608a5f42bb4d9fa856aa731edce3c907feda4080d149bed"} Jun 11 14:17:42.059842 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.059805 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"12a64448eb9c115858d5296ce6051445eac9cd4012f919029a9de8243bc3149e"} Jun 11 14:17:42.128214 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.128188 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:17:42.953308 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.953274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:42.953574 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.953279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:42.953574 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:42.953422 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:42.953574 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.953280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:42.953574 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:42.953493 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:42.953739 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:42.953605 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:42.964120 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.964022 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:17:42.12821016Z","UUID":"471dbce2-6039-46d8-bb60-b0a914c74ba3","Handler":null,"Name":"","Endpoint":""} Jun 11 14:17:42.966891 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.966873 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:17:42.967012 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:42.966913 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:17:43.063734 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.063701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" event={"ID":"319cffac-f541-4d8a-b0ce-51aa8f15b191","Type":"ContainerStarted","Data":"09f29497d23061063368e31f52ba28762183c2695c1ec7c77f0e4f4b34909c29"} Jun 11 14:17:43.066022 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.066004 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:17:43.066338 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.066319 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"38f246138323faa29fa4e72b728eb521f4d8814f3ba478190763e1dd39747b3d"} Jun 11 14:17:43.066405 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.066383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"241546d5fafa11ab0d5ecb05b8abd1dbd8a289ec36b5f0da529ba63ec76589cc"} Jun 11 14:17:43.067452 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.067422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7nmx" event={"ID":"85c2f4f6-51a1-409a-8d62-cfe509b509c9","Type":"ContainerStarted","Data":"844e18b1048d1e8a1f4a9429ab324820d1e4938a1b8ef94bb90a2da73a1ce56f"} Jun 11 14:17:43.095399 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.095347 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l7nmx" podStartSLOduration=5.2657334989999995 podStartE2EDuration="24.095329605s" totalImagesPullingTime="18.829596106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:43.09509351 +0000 UTC m=+24.655747901" watchObservedRunningTime="2026-06-11 14:17:43.095329605 +0000 UTC m=+24.655983995" Jun 11 14:17:43.215417 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.215343 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:43.266679 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.266647 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:43.761570 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.761538 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:43.762188 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:43.762164 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:44.071648 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.071565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" event={"ID":"319cffac-f541-4d8a-b0ce-51aa8f15b191","Type":"ContainerStarted","Data":"dea7ff4d9b575e3dfdfe32d8b8881021ffa490f5eced467e92a4963692ba485f"} Jun 11 14:17:44.072200 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.071958 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:44.072272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.072258 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5pv28" Jun 11 14:17:44.087915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.087878 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbbxc" podStartSLOduration=4.20659216 podStartE2EDuration="25.087864429s" totalImagesPullingTime="20.881272269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:44.087649535 +0000 UTC m=+25.648303926" watchObservedRunningTime="2026-06-11 14:17:44.087864429 +0000 UTC m=+25.648518818" Jun 11 14:17:44.148160 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.148128 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:44.953349 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.953313 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:44.953531 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.953380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:44.953531 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:44.953379 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:44.953531 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:44.953476 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:44.953689 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:44.953630 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:44.953746 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:44.953686 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:45.077081 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:45.077033 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:17:45.077619 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:45.077463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"292a383caee6d6927ba10f719f29be8169fe286904cf4cbb0de31795ab8a579f"} Jun 11 14:17:46.952907 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:46.952875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:46.953538 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:46.953001 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:46.953538 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:46.953087 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:46.953538 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:46.953231 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:46.953538 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:46.953269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:46.953538 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:46.953357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:48.087942 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.087701 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:17:48.088389 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.088228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"0bf56fa93edc946f1d633959abe169f4bc56004fc0861ad0397ba6253afaa3bf"} Jun 11 14:17:48.088574 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.088549 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:48.088710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.088661 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:48.088710 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.088699 2580 scope.go:117] "RemoveContainer" containerID="dfb37f9cbce5fd7e8608a5f42bb4d9fa856aa731edce3c907feda4080d149bed" Jun 11 14:17:48.105755 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.105735 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:48.954413 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.954375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:48.954622 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:48.954465 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:48.954622 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.954497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:48.954622 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:48.954579 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:48.954622 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:48.954602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:48.954764 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:48.954677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:49.095177 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.095105 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:17:49.095619 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.095540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" event={"ID":"8f81b9a0-1c04-4221-9cab-437f0066c3a3","Type":"ContainerStarted","Data":"4361024fd8ef83d02d5a4446f0319fb6d769f3ea82cbaba77d2127ec2f6a4535"} Jun 11 14:17:49.095893 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.095854 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:49.098050 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.098008 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="15e86570c6bab6c86d53168bed25dbd41ff41546296f29195741e8931e43dccb" exitCode=0 Jun 11 14:17:49.098154 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.098077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"15e86570c6bab6c86d53168bed25dbd41ff41546296f29195741e8931e43dccb"} Jun 11 14:17:49.116956 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.116931 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:17:49.122389 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:49.122335 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" podStartSLOduration=10.792951187 podStartE2EDuration="30.122316298s" totalImagesPullingTime="19.329365111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:49.120541372 +0000 UTC m=+30.681195772" watchObservedRunningTime="2026-06-11 14:17:49.122316298 +0000 UTC m=+30.682970689" Jun 11 14:17:50.091769 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.091624 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zq856"] Jun 11 14:17:50.091891 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.091876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:50.092030 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:50.092002 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:50.094551 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.094524 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6qdj"] Jun 11 14:17:50.094669 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.094619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:50.094730 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:50.094687 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:50.095000 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.094977 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtmtn"] Jun 11 14:17:50.095097 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:50.095086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:50.095188 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:50.095168 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:51.106099 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:51.106062 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="0a7107f2c4dc2257bbf7c0f4b17f44f581fe2b7382c799d4824f301574a97914" exitCode=0 Jun 11 14:17:51.106898 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:51.106157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"0a7107f2c4dc2257bbf7c0f4b17f44f581fe2b7382c799d4824f301574a97914"} Jun 11 14:17:51.952941 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:51.952917 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:51.953083 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:51.952917 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:51.953083 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:51.953021 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:51.953166 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:51.952917 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:51.953166 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:51.953118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:51.953236 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:51.953217 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:52.651968 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:52.651939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:52.652448 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.652055 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:52.652448 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.652103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:18:24.65209046 +0000 UTC m=+66.212744827 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:52.752923 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:52.752885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:52.753071 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:52.752930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:52.753071 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753055 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:52.753071 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753057 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:52.753178 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753122 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret podName:d3d8812a-32b3-4a5f-8c9b-9e83229a9043 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:24.753108264 +0000 UTC m=+66.313762635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret") pod "global-pull-secret-syncer-mtmtn" (UID: "d3d8812a-32b3-4a5f-8c9b-9e83229a9043") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:52.753178 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753068 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:52.753178 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753159 2580 projected.go:196] Error preparing data for projected volume kube-api-access-dnjzg for pod openshift-network-diagnostics/network-check-target-q6qdj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:52.753268 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:52.753223 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg podName:7aea8b1b-2fcd-40bb-8672-9e2c73d39d21 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:24.753192892 +0000 UTC m=+66.313847279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dnjzg" (UniqueName: "kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg") pod "network-check-target-q6qdj" (UID: "7aea8b1b-2fcd-40bb-8672-9e2c73d39d21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:53.113717 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:53.113688 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="4acc1b3c958ad84fa6698bf13bd900d3992ca75700f6d8972cff2d1659f09ce9" exitCode=0 Jun 11 14:17:53.113872 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:53.113733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"4acc1b3c958ad84fa6698bf13bd900d3992ca75700f6d8972cff2d1659f09ce9"} Jun 11 14:17:53.953779 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:53.953746 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:53.954303 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:53.953792 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:53.954303 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:53.953860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:53.954303 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:53.953877 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:17:53.954303 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:53.953938 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6qdj" podUID="7aea8b1b-2fcd-40bb-8672-9e2c73d39d21" Jun 11 14:17:53.954303 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:53.953994 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtmtn" podUID="d3d8812a-32b3-4a5f-8c9b-9e83229a9043" Jun 11 14:17:54.194369 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.194335 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:54.293941 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.293899 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:54.754740 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.754709 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-224.ec2.internal" event="NodeReady" Jun 11 14:17:54.754905 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.754877 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:17:54.799209 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.799178 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nkpqz"] Jun 11 14:17:54.801216 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.801195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:54.803401 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.803376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:17:54.803641 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.803621 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw4vr\"" Jun 11 14:17:54.803758 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.803640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:17:54.806440 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.806419 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nlh89"] Jun 11 14:17:54.808415 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.808395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:54.810678 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.810658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:17:54.810678 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.810658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqzqr\"" Jun 11 14:17:54.810825 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.810720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:17:54.810825 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.810658 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:17:54.814466 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.814444 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nkpqz"] Jun 11 14:17:54.817603 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.817580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlh89"] Jun 11 14:17:54.919638 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.919605 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:54.968231 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8jt\" (UniqueName: \"kubernetes.io/projected/915a2b77-149f-4202-89ff-62b9c6283997-kube-api-access-5p8jt\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:54.968231 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lpnc\" (UniqueName: \"kubernetes.io/projected/a480903b-60e9-4366-a942-e59914f55f9b-kube-api-access-5lpnc\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:54.968699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/915a2b77-149f-4202-89ff-62b9c6283997-tmp-dir\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:54.968699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/915a2b77-149f-4202-89ff-62b9c6283997-config-volume\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:54.968699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:54.968699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.968459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a480903b-60e9-4366-a942-e59914f55f9b-cert\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:54.976799 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:54.976763 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:55.069015 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.068928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/915a2b77-149f-4202-89ff-62b9c6283997-config-volume\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.069015 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.068960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.069015 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.068979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a480903b-60e9-4366-a942-e59914f55f9b-cert\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:55.069294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.069022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8jt\" (UniqueName: \"kubernetes.io/projected/915a2b77-149f-4202-89ff-62b9c6283997-kube-api-access-5p8jt\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.069294 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:55.069121 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:55.069294 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:55.069182 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:55.5691625 +0000 UTC m=+37.129816881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:17:55.069294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.069200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lpnc\" (UniqueName: \"kubernetes.io/projected/a480903b-60e9-4366-a942-e59914f55f9b-kube-api-access-5lpnc\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:55.069294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.069235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/915a2b77-149f-4202-89ff-62b9c6283997-tmp-dir\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.069610 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.069581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/915a2b77-149f-4202-89ff-62b9c6283997-tmp-dir\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.069736 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.069695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/915a2b77-149f-4202-89ff-62b9c6283997-config-volume\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.074139 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.073969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a480903b-60e9-4366-a942-e59914f55f9b-cert\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:55.080212 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.080184 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8jt\" (UniqueName: \"kubernetes.io/projected/915a2b77-149f-4202-89ff-62b9c6283997-kube-api-access-5p8jt\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.080686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.080664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lpnc\" (UniqueName: \"kubernetes.io/projected/a480903b-60e9-4366-a942-e59914f55f9b-kube-api-access-5lpnc\") pod \"ingress-canary-nlh89\" (UID: \"a480903b-60e9-4366-a942-e59914f55f9b\") " pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:55.122281 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.122250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlh89" Jun 11 14:17:55.275646 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.275614 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlh89"] Jun 11 14:17:55.280473 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:55.280441 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda480903b_60e9_4366_a942_e59914f55f9b.slice/crio-859ec1265ae930b33fecd2487aeaeaaa4c8ca80b51f49dda9241a5072041e13a WatchSource:0}: Error finding container 859ec1265ae930b33fecd2487aeaeaaa4c8ca80b51f49dda9241a5072041e13a: Status 404 returned error can't find the container with id 859ec1265ae930b33fecd2487aeaeaaa4c8ca80b51f49dda9241a5072041e13a Jun 11 14:17:55.573459 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.573421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:55.573644 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:55.573561 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:55.573644 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:55.573622 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:56.573606792 +0000 UTC m=+38.134261177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:17:55.953096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.952961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:17:55.953096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.952990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:17:55.953096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.952997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:17:55.956594 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956568 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:17:55.956594 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956587 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:17:55.956743 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:17:55.956743 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mz2g\"" Jun 11 14:17:55.956810 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956767 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:17:55.956810 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:55.956767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rmvh\"" Jun 11 14:17:56.123613 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:56.123571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlh89" event={"ID":"a480903b-60e9-4366-a942-e59914f55f9b","Type":"ContainerStarted","Data":"859ec1265ae930b33fecd2487aeaeaaa4c8ca80b51f49dda9241a5072041e13a"} Jun 11 14:17:56.580725 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:56.580684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:56.580917 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:56.580853 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:56.580980 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:56.580932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:58.580909676 +0000 UTC m=+40.141564057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:17:57.065518 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.065321 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8"] Jun 11 14:17:57.068426 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.067616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.068426 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.068381 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52"] Jun 11 14:17:57.070191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.070167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 14:17:57.070409 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.070371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.070493 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.070479 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 14:17:57.070709 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.070592 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 14:17:57.070790 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.070740 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 14:17:57.072691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.072597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 14:17:57.072691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.072608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 14:17:57.072691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.072622 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 14:17:57.072966 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.072944 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 14:17:57.077294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.077216 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8"] Jun 11 14:17:57.083353 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.083299 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52"] Jun 11 14:17:57.129155 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.129107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerStarted","Data":"c88b6a6fe7d72efb138c908eabefa4c8921048c206428fbe28bfc63283b93cd5"} Jun 11 14:17:57.185943 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.185919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186046 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.185974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a03a1214-6e33-4058-8714-1a734692432e-tmp\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.186107 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186107 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186168 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/079a494f-0007-4f63-a30c-3ed331d2aaee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186168 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9vz\" (UniqueName: \"kubernetes.io/projected/079a494f-0007-4f63-a30c-3ed331d2aaee-kube-api-access-pq9vz\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186168 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a03a1214-6e33-4058-8714-1a734692432e-klusterlet-config\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.186294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.186294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.186234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt55h\" (UniqueName: \"kubernetes.io/projected/a03a1214-6e33-4058-8714-1a734692432e-kube-api-access-jt55h\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.287561 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a03a1214-6e33-4058-8714-1a734692432e-tmp\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.287561 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287561 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/079a494f-0007-4f63-a30c-3ed331d2aaee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9vz\" (UniqueName: \"kubernetes.io/projected/079a494f-0007-4f63-a30c-3ed331d2aaee-kube-api-access-pq9vz\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a03a1214-6e33-4058-8714-1a734692432e-klusterlet-config\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.287811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287998 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt55h\" (UniqueName: \"kubernetes.io/projected/a03a1214-6e33-4058-8714-1a734692432e-kube-api-access-jt55h\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.287998 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.287998 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.287918 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a03a1214-6e33-4058-8714-1a734692432e-tmp\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.288347 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.288321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/079a494f-0007-4f63-a30c-3ed331d2aaee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.291689 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.291655 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-ca\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.291827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.291721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.291827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.291781 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.291827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.291813 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a03a1214-6e33-4058-8714-1a734692432e-klusterlet-config\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.291959 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.291816 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/079a494f-0007-4f63-a30c-3ed331d2aaee-hub\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.295747 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.295727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt55h\" (UniqueName: \"kubernetes.io/projected/a03a1214-6e33-4058-8714-1a734692432e-kube-api-access-jt55h\") pod \"klusterlet-addon-workmgr-885797f4b-nkcx8\" (UID: \"a03a1214-6e33-4058-8714-1a734692432e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.296139 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.296120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9vz\" (UniqueName: \"kubernetes.io/projected/079a494f-0007-4f63-a30c-3ed331d2aaee-kube-api-access-pq9vz\") pod \"cluster-proxy-proxy-agent-6c69759ff7-bjv52\" (UID: \"079a494f-0007-4f63-a30c-3ed331d2aaee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.383835 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.383803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:17:57.396639 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.396373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:17:57.533708 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.533679 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8"] Jun 11 14:17:57.537289 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:57.537263 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03a1214_6e33_4058_8714_1a734692432e.slice/crio-87a34596b3fcc6836e6ebfc3a839351604c7a2f2b3716c53a54cc148a0ea7ab3 WatchSource:0}: Error finding container 87a34596b3fcc6836e6ebfc3a839351604c7a2f2b3716c53a54cc148a0ea7ab3: Status 404 returned error can't find the container with id 87a34596b3fcc6836e6ebfc3a839351604c7a2f2b3716c53a54cc148a0ea7ab3 Jun 11 14:17:57.547656 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:57.547634 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52"] Jun 11 14:17:57.550272 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:17:57.550246 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod079a494f_0007_4f63_a30c_3ed331d2aaee.slice/crio-63103d197299f983232cdd99244a7d90eb26bb2932bce9d7240ab8d44b8c6728 WatchSource:0}: Error finding container 63103d197299f983232cdd99244a7d90eb26bb2932bce9d7240ab8d44b8c6728: Status 404 returned error can't find the container with id 63103d197299f983232cdd99244a7d90eb26bb2932bce9d7240ab8d44b8c6728 Jun 11 14:17:58.132436 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.132404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerStarted","Data":"63103d197299f983232cdd99244a7d90eb26bb2932bce9d7240ab8d44b8c6728"} Jun 11 14:17:58.133449 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.133428 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" event={"ID":"a03a1214-6e33-4058-8714-1a734692432e","Type":"ContainerStarted","Data":"87a34596b3fcc6836e6ebfc3a839351604c7a2f2b3716c53a54cc148a0ea7ab3"} Jun 11 14:17:58.135930 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.135904 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="c88b6a6fe7d72efb138c908eabefa4c8921048c206428fbe28bfc63283b93cd5" exitCode=0 Jun 11 14:17:58.136015 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.135940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"c88b6a6fe7d72efb138c908eabefa4c8921048c206428fbe28bfc63283b93cd5"} Jun 11 14:17:58.600364 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.600273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:17:58.600528 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:58.600483 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:58.601150 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:17:58.600647 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:02.60054047 +0000 UTC m=+44.161194856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:17:58.766329 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.766256 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:58.825382 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:58.825346 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:17:59.144226 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:59.143336 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5b54f23-835a-49a0-be44-c01200150da7" containerID="1d56b8d6de3498f8f470663feb2c345f80bf522839c3f9d190048a86d267b315" exitCode=0 Jun 11 14:17:59.144226 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:17:59.143403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerDied","Data":"1d56b8d6de3498f8f470663feb2c345f80bf522839c3f9d190048a86d267b315"} Jun 11 14:18:01.602660 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:01.602615 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:01.660326 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:01.660290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:02.636608 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:02.636565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:18:02.636985 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:02.636701 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:02.636985 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:02.636762 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:10.636745918 +0000 UTC m=+52.197400287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:18:04.158793 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.158756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerStarted","Data":"32e6a4e0a9bfd9957ef2bd316c87159d33af676130327b7609b31638a0245a37"} Jun 11 14:18:04.159251 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.158806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerStarted","Data":"a47a73e407f58555b31da71c4200693c4e476f5953607173368d79a64a588216"} Jun 11 14:18:04.159251 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.158825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerStarted","Data":"cdeb58a2def39e30c095a54963df16deacea17761aeee28a0d02d630edd9e739"} Jun 11 14:18:04.160368 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.160342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" event={"ID":"a03a1214-6e33-4058-8714-1a734692432e","Type":"ContainerStarted","Data":"1d14f6f872aa7231077d7538fb73476f66ca195b4da43967546e385aa75a9e12"} Jun 11 14:18:04.160491 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.160395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:18:04.162098 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.162070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlh89" event={"ID":"a480903b-60e9-4366-a942-e59914f55f9b","Type":"ContainerStarted","Data":"377ef1ecc6dfa155d48097690d3a467681e3717ca95c9fd6ec9c43c53f7165aa"} Jun 11 14:18:04.162479 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.162463 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:18:04.165365 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.165345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" event={"ID":"d5b54f23-835a-49a0-be44-c01200150da7","Type":"ContainerStarted","Data":"e30e04fc69c6cd74e6da607600d691e763cb2876ca80dd5bc6ca0eff052fa8a5"} Jun 11 14:18:04.179817 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.179774 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" podStartSLOduration=0.997092277 podStartE2EDuration="7.179760864s" totalImagesPullingTime="6.182668587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:04.179410194 +0000 UTC m=+45.740064582" watchObservedRunningTime="2026-06-11 14:18:04.179760864 +0000 UTC m=+45.740415250" Jun 11 14:18:04.199167 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.199121 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h8zrq" podStartSLOduration=13.485525138 podStartE2EDuration="45.199107261s" totalImagesPullingTime="31.713582123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:04.198217833 +0000 UTC m=+45.758872213" watchObservedRunningTime="2026-06-11 14:18:04.199107261 +0000 UTC m=+45.759761649" Jun 11 14:18:04.211880 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.211796 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" podStartSLOduration=1.001715343 podStartE2EDuration="7.211782753s" totalImagesPullingTime="6.21006741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:04.211312351 +0000 UTC m=+45.771966739" watchObservedRunningTime="2026-06-11 14:18:04.211782753 +0000 UTC m=+45.772437163" Jun 11 14:18:04.224263 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.224222 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nlh89" podStartSLOduration=1.8090157580000001 podStartE2EDuration="10.224207007s" totalImagesPullingTime="8.415191249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:04.223943326 +0000 UTC m=+45.784597716" watchObservedRunningTime="2026-06-11 14:18:04.224207007 +0000 UTC m=+45.784861396" Jun 11 14:18:04.289050 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.289016 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:04.393288 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:04.393258 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:10.692177 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:10.692135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:18:10.692690 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:10.692301 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:10.692690 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:10.692370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:26.692355167 +0000 UTC m=+68.253009538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:18:21.117495 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:21.117466 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cg9v5" Jun 11 14:18:21.266021 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:21.265977 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:21.329465 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:21.329426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:18:24.689417 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.689380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:18:24.691765 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.691746 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:18:24.700407 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:24.700384 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:18:24.700477 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:24.700466 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:19:28.700448488 +0000 UTC m=+130.261102867 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : secret "metrics-daemon-secret" not found Jun 11 14:18:24.790361 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.790313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:18:24.790545 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.790452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:18:24.793675 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.793648 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:18:24.793675 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.793666 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:18:24.802708 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.802684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:18:24.802930 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.802913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3d8812a-32b3-4a5f-8c9b-9e83229a9043-original-pull-secret\") pod \"global-pull-secret-syncer-mtmtn\" (UID: \"d3d8812a-32b3-4a5f-8c9b-9e83229a9043\") " pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:18:24.831238 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:24.831206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjzg\" (UniqueName: \"kubernetes.io/projected/7aea8b1b-2fcd-40bb-8672-9e2c73d39d21-kube-api-access-dnjzg\") pod \"network-check-target-q6qdj\" (UID: \"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21\") " pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:18:25.067465 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.067438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtmtn" Jun 11 14:18:25.077482 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.077453 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rmvh\"" Jun 11 14:18:25.086404 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.086374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:18:25.198589 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.198557 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtmtn"] Jun 11 14:18:25.201639 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:18:25.201613 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d8812a_32b3_4a5f_8c9b_9e83229a9043.slice/crio-f3d7b9edfe884aa24f2551b9555ca76d898ae594e83c0fb604780a102ad22365 WatchSource:0}: Error finding container f3d7b9edfe884aa24f2551b9555ca76d898ae594e83c0fb604780a102ad22365: Status 404 returned error can't find the container with id f3d7b9edfe884aa24f2551b9555ca76d898ae594e83c0fb604780a102ad22365 Jun 11 14:18:25.214748 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.214668 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6qdj"] Jun 11 14:18:25.218531 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:18:25.218501 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aea8b1b_2fcd_40bb_8672_9e2c73d39d21.slice/crio-39c71651445944f8e6904cd2b5d9971b5929cd934d2d16fb5ed88fbcf36555e6 WatchSource:0}: Error finding container 39c71651445944f8e6904cd2b5d9971b5929cd934d2d16fb5ed88fbcf36555e6: Status 404 returned error can't find the container with id 39c71651445944f8e6904cd2b5d9971b5929cd934d2d16fb5ed88fbcf36555e6 Jun 11 14:18:25.218888 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:25.218858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtmtn" event={"ID":"d3d8812a-32b3-4a5f-8c9b-9e83229a9043","Type":"ContainerStarted","Data":"f3d7b9edfe884aa24f2551b9555ca76d898ae594e83c0fb604780a102ad22365"} Jun 11 14:18:26.223250 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:26.223191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6qdj" event={"ID":"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21","Type":"ContainerStarted","Data":"39c71651445944f8e6904cd2b5d9971b5929cd934d2d16fb5ed88fbcf36555e6"} Jun 11 14:18:26.706818 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:26.706739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:18:26.707130 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:26.706898 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:26.707130 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:26.706972 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:58.706952715 +0000 UTC m=+100.267607099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:18:28.233855 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:28.233822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6qdj" event={"ID":"7aea8b1b-2fcd-40bb-8672-9e2c73d39d21","Type":"ContainerStarted","Data":"8e958d939e4d50881a691ab84628c59ec78d308719776d0acf5fe3c80bb5c859"} Jun 11 14:18:28.234196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:28.233940 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:18:28.248560 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:28.248499 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q6qdj" podStartSLOduration=66.309033225 podStartE2EDuration="1m9.24844155s" totalImagesPullingTime="2.939408325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:28.24821912 +0000 UTC m=+69.808873510" watchObservedRunningTime="2026-06-11 14:18:28.24844155 +0000 UTC m=+69.809095950" Jun 11 14:18:30.241420 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:30.241383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtmtn" event={"ID":"d3d8812a-32b3-4a5f-8c9b-9e83229a9043","Type":"ContainerStarted","Data":"a93b1d41b18b549a0797c5bc6b446bd6d881fb1d545f921170598dfb6dbe5190"} Jun 11 14:18:30.257194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:30.257144 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtmtn" podStartSLOduration=66.700162023 podStartE2EDuration="1m11.257129885s" totalImagesPullingTime="4.556967862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:30.255999818 +0000 UTC m=+71.816654208" watchObservedRunningTime="2026-06-11 14:18:30.257129885 +0000 UTC m=+71.817784274" Jun 11 14:18:58.726570 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:58.726525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:18:58.727119 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:58.726672 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:58.727119 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:18:58.726751 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:02.726733173 +0000 UTC m=+164.287387544 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:18:59.239812 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:18:59.239783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q6qdj" Jun 11 14:19:28.729703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:19:28.729659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:19:28.730225 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:19:28.729789 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:19:28.730225 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:19:28.729842 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs podName:4bea2e6c-b314-4925-9a38-8bd04d7c8d5b nodeName:}" failed. No retries permitted until 2026-06-11 14:21:30.729827499 +0000 UTC m=+252.290481866 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs") pod "network-metrics-daemon-zq856" (UID: "4bea2e6c-b314-4925-9a38-8bd04d7c8d5b") : secret "metrics-daemon-secret" not found Jun 11 14:19:57.813244 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:19:57.813185 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nkpqz" podUID="915a2b77-149f-4202-89ff-62b9c6283997" Jun 11 14:19:58.483765 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:19:58.483732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:19:58.981058 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:19:58.981007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zq856" podUID="4bea2e6c-b314-4925-9a38-8bd04d7c8d5b" Jun 11 14:20:00.982507 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:00.982477 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:02.779774 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:02.779728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:20:02.780163 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:20:02.779871 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:20:02.780163 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:20:02.779956 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls podName:915a2b77-149f-4202-89ff-62b9c6283997 nodeName:}" failed. No retries permitted until 2026-06-11 14:22:04.779923915 +0000 UTC m=+286.340578283 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls") pod "dns-default-nkpqz" (UID: "915a2b77-149f-4202-89ff-62b9c6283997") : secret "dns-default-metrics-tls" not found Jun 11 14:20:04.161116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:04.161034 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" podUID="a03a1214-6e33-4058-8714-1a734692432e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 11 14:20:04.501667 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:04.501635 2580 generic.go:356] "Generic (PLEG): container finished" podID="a03a1214-6e33-4058-8714-1a734692432e" containerID="1d14f6f872aa7231077d7538fb73476f66ca195b4da43967546e385aa75a9e12" exitCode=1 Jun 11 14:20:04.501844 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:04.501685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" event={"ID":"a03a1214-6e33-4058-8714-1a734692432e","Type":"ContainerDied","Data":"1d14f6f872aa7231077d7538fb73476f66ca195b4da43967546e385aa75a9e12"} Jun 11 14:20:04.501986 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:04.501974 2580 scope.go:117] "RemoveContainer" containerID="1d14f6f872aa7231077d7538fb73476f66ca195b4da43967546e385aa75a9e12" Jun 11 14:20:05.508477 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:05.508440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" event={"ID":"a03a1214-6e33-4058-8714-1a734692432e","Type":"ContainerStarted","Data":"2f2754342f48cbe1820e07c5232020c103f538a757f39cbfd2468a6749eeec5f"} Jun 11 14:20:05.508972 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:05.508734 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:20:05.509277 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:05.509259 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-885797f4b-nkcx8" Jun 11 14:20:13.953817 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:13.953714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:20:31.807558 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:31.807524 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:31.907849 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:31.907817 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:34.007255 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:34.007215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:34.077570 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:34.077528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:36.826448 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:36.826415 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:36.890968 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:36.890926 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:37.363609 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:37.363579 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:37.542207 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:37.542164 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:37.646053 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:37.645951 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:37.879026 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:37.879000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:37.945852 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:37.945766 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:38.176672 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:38.176641 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:38.276187 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:38.276113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:38.752538 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:38.752513 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm2zr_32a1d6ee-a64c-40eb-aaca-44a2ed3daef3/dns-node-resolver/0.log" Jun 11 14:20:39.696560 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:39.696520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:39.795089 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:39.795032 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:39.922931 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:39.922888 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:39.955826 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:39.955767 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nsjmk_0a7d6e05-4f94-4bfe-974f-d29eb0acbead/node-ca/0.log" Jun 11 14:20:40.747195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:40.747170 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlh89_a480903b-60e9-4366-a942-e59914f55f9b/serve-healthcheck-canary/0.log" Jun 11 14:20:41.230186 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:41.230156 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:42.611770 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:42.611732 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:42.838192 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:42.838158 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:42.988209 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:42.988115 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:43.150594 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:43.150560 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:43.279062 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:43.278966 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:43.403446 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:43.403411 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:43.674304 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:43.674272 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:44.620072 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:44.620022 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:44.983779 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:44.983690 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:45.210803 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:45.210770 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:45.409634 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:45.409598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:45.632198 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:45.632162 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:46.470020 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:46.469991 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:46.632437 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:46.632405 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:46.772270 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:46.772174 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:47.119149 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:47.119105 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:47.321177 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:47.321147 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:47.566144 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:47.566110 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:47.735381 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:47.735353 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:48.738641 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:48.738607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.050447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.050420 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.239317 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.239286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.464287 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.464190 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.657322 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.657290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.809083 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.809024 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:49.920787 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:49.920746 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:50.455714 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:50.455668 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:51.055272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:51.055231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:51.224255 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:51.224219 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:51.634734 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:51.634694 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:51.899745 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:51.899661 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:52.246640 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:52.246557 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:52.823195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:52.823161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:52.969683 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:52.969645 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:53.153694 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:53.153595 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:53.238093 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:53.238062 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:20:53.593490 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:20:53.593465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:04.491839 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.491798 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmnh"] Jun 11 14:21:04.494983 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.494960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.497344 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.497318 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-6gmnh\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" podUID="fb0b700d-50e9-44e9-a439-76a497b38b2c" pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.497592 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.497569 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 11 14:21:04.497679 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.497640 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 11 14:21:04.497726 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.497671 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 11 14:21:04.498860 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.498834 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 11 14:21:04.503863 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:04.503842 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-5cgdf\" is forbidden: User \"system:node:ip-10-0-137-224.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-137-224.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cgdf\"" type="*v1.Secret" Jun 11 14:21:04.526342 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.526316 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmnh"] Jun 11 14:21:04.627460 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.627429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b700d-50e9-44e9-a439-76a497b38b2c-data-volume\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.627460 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.627461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hss\" (UniqueName: \"kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.627638 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.627527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b700d-50e9-44e9-a439-76a497b38b2c-crio-socket\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.627638 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.627544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.627638 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.627565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.637514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.637484 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:04.728305 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b700d-50e9-44e9-a439-76a497b38b2c-crio-socket\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728305 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b700d-50e9-44e9-a439-76a497b38b2c-data-volume\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hss\" (UniqueName: \"kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb0b700d-50e9-44e9-a439-76a497b38b2c-crio-socket\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.728693 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.728675 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb0b700d-50e9-44e9-a439-76a497b38b2c-data-volume\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:04.745419 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:04.745347 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:05.449191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:05.449161 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cgdf\"" Jun 11 14:21:05.728598 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.728490 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Jun 11 14:21:05.728598 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.728604 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm podName:fb0b700d-50e9-44e9-a439-76a497b38b2c nodeName:}" failed. No retries permitted until 2026-06-11 14:21:06.228580124 +0000 UTC m=+227.789234491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gmnh" (UID: "fb0b700d-50e9-44e9-a439-76a497b38b2c") : failed to sync configmap cache: timed out waiting for the condition Jun 11 14:21:05.729093 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.728490 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Jun 11 14:21:05.729093 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.728689 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls podName:fb0b700d-50e9-44e9-a439-76a497b38b2c nodeName:}" failed. No retries permitted until 2026-06-11 14:21:06.228672235 +0000 UTC m=+227.789326602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gmnh" (UID: "fb0b700d-50e9-44e9-a439-76a497b38b2c") : failed to sync secret cache: timed out waiting for the condition Jun 11 14:21:05.737206 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.737182 2580 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 11 14:21:05.771479 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:05.771451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:21:05.792455 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:05.792431 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:21:05.881369 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:05.881341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:21:05.887516 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.887500 2580 projected.go:196] Error preparing data for projected volume kube-api-access-l4hss for pod openshift-insights/insights-runtime-extractor-6gmnh: failed to sync configmap cache: timed out waiting for the condition Jun 11 14:21:05.887570 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:21:05.887562 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss podName:fb0b700d-50e9-44e9-a439-76a497b38b2c nodeName:}" failed. No retries permitted until 2026-06-11 14:21:06.387541693 +0000 UTC m=+227.948196062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l4hss" (UniqueName: "kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss") pod "insights-runtime-extractor-6gmnh" (UID: "fb0b700d-50e9-44e9-a439-76a497b38b2c") : failed to sync configmap cache: timed out waiting for the condition Jun 11 14:21:05.930515 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:05.930491 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:21:06.188545 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.188511 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:06.238091 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.238061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.238244 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.238098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.238608 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.238576 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.240304 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.240287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb0b700d-50e9-44e9-a439-76a497b38b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.293793 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.293759 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:06.439991 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.439907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hss\" (UniqueName: \"kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.442241 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.442213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hss\" (UniqueName: \"kubernetes.io/projected/fb0b700d-50e9-44e9-a439-76a497b38b2c-kube-api-access-l4hss\") pod \"insights-runtime-extractor-6gmnh\" (UID: \"fb0b700d-50e9-44e9-a439-76a497b38b2c\") " pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.603351 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.603318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gmnh" Jun 11 14:21:06.767678 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.767607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gmnh"] Jun 11 14:21:06.772425 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:06.772386 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0b700d_50e9_44e9_a439_76a497b38b2c.slice/crio-254a1c1b19af52aa147d3e88331e8406d7d88b785b32b8f421570698255ce09f WatchSource:0}: Error finding container 254a1c1b19af52aa147d3e88331e8406d7d88b785b32b8f421570698255ce09f: Status 404 returned error can't find the container with id 254a1c1b19af52aa147d3e88331e8406d7d88b785b32b8f421570698255ce09f Jun 11 14:21:06.994989 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:06.994952 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:07.120739 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.120709 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:07.226839 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.226804 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw"] Jun 11 14:21:07.229722 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.229704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:07.232236 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.232209 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:07.232732 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.232712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 14:21:07.232854 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.232840 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-82wzc\"" Jun 11 14:21:07.244950 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.244922 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw"] Jun 11 14:21:07.346410 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.346369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/37611ace-4989-4a58-aff4-bf1df7359629-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kfzmw\" (UID: \"37611ace-4989-4a58-aff4-bf1df7359629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:07.437898 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.437866 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:07.446955 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.446923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/37611ace-4989-4a58-aff4-bf1df7359629-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kfzmw\" (UID: \"37611ace-4989-4a58-aff4-bf1df7359629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:07.449337 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.449310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/37611ace-4989-4a58-aff4-bf1df7359629-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kfzmw\" (UID: \"37611ace-4989-4a58-aff4-bf1df7359629\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:07.518469 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.518430 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:07.538591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.538564 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:07.664148 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.664076 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw"] Jun 11 14:21:07.668598 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:07.668569 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37611ace_4989_4a58_aff4_bf1df7359629.slice/crio-2531d9953e0444eea7509141f606291a98e845e41aa6da445e8fc02431afe715 WatchSource:0}: Error finding container 2531d9953e0444eea7509141f606291a98e845e41aa6da445e8fc02431afe715: Status 404 returned error can't find the container with id 2531d9953e0444eea7509141f606291a98e845e41aa6da445e8fc02431afe715 Jun 11 14:21:07.674679 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.674655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" event={"ID":"37611ace-4989-4a58-aff4-bf1df7359629","Type":"ContainerStarted","Data":"2531d9953e0444eea7509141f606291a98e845e41aa6da445e8fc02431afe715"} Jun 11 14:21:07.676185 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.676154 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmnh" event={"ID":"fb0b700d-50e9-44e9-a439-76a497b38b2c","Type":"ContainerStarted","Data":"6501c42a32b43c44d601a9d1461bd023290b606823e60a5827a455a6a19293c4"} Jun 11 14:21:07.676284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.676199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmnh" event={"ID":"fb0b700d-50e9-44e9-a439-76a497b38b2c","Type":"ContainerStarted","Data":"9ec5f778027a8776f2fcf599bbbc0b07d1df7dfa7e9ee54f9658dae06ee0b80a"} Jun 11 14:21:07.676284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:07.676218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmnh" event={"ID":"fb0b700d-50e9-44e9-a439-76a497b38b2c","Type":"ContainerStarted","Data":"254a1c1b19af52aa147d3e88331e8406d7d88b785b32b8f421570698255ce09f"} Jun 11 14:21:09.685284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.685192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" event={"ID":"37611ace-4989-4a58-aff4-bf1df7359629","Type":"ContainerStarted","Data":"2a4534b18fb946483244fe9d7e314ca41e7799c07a32b98debb3f314c7e4aba5"} Jun 11 14:21:09.685707 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.685334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:09.687356 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.687331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gmnh" event={"ID":"fb0b700d-50e9-44e9-a439-76a497b38b2c","Type":"ContainerStarted","Data":"995e70910677382271947968fe375756631a8e95a610248ba2747092902f0034"} Jun 11 14:21:09.690148 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.690129 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" Jun 11 14:21:09.747309 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.747259 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6gmnh" podStartSLOduration=3.913189912 podStartE2EDuration="5.747243658s" totalImagesPullingTime="1.834053746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:21:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:09.746775333 +0000 UTC m=+231.307429723" watchObservedRunningTime="2026-06-11 14:21:09.747243658 +0000 UTC m=+231.307898047" Jun 11 14:21:09.747582 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:09.747560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kfzmw" podStartSLOduration=0.992713506 podStartE2EDuration="2.747550964s" totalImagesPullingTime="1.754837458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:09.711146795 +0000 UTC m=+231.271801184" watchObservedRunningTime="2026-06-11 14:21:09.747550964 +0000 UTC m=+231.308205360" Jun 11 14:21:10.281997 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:10.281965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:10.393721 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:10.393688 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:10.659970 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:10.659935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:12.548985 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:12.548944 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:14.505558 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.505522 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:14.742460 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.742424 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:14.823577 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.823547 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns"] Jun 11 14:21:14.826720 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.826698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:14.831326 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.831307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:21:14.831414 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.831398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:21:14.832119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.832100 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 14:21:14.832196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.832115 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:21:14.832196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.832140 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:21:14.832196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.832168 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-79gm4\"" Jun 11 14:21:14.908624 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.908594 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w7zbc"] Jun 11 14:21:14.911586 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.911571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:14.914768 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.914748 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:21:14.920790 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.920774 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:21:14.921218 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.921197 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:21:14.921329 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.921204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8wt2r\"" Jun 11 14:21:14.922233 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.922216 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns"] Jun 11 14:21:14.945464 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:14.945443 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.006821 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.006821 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006823 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7076beb-ed78-476e-99da-3947fd9c1f33-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.007011 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-metrics-client-ca\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007011 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-tls\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007011 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.007011 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.006966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-sys\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007164 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm7hc\" (UniqueName: \"kubernetes.io/projected/fd56f0c1-e63b-42c0-b85e-9038a3470c39-kube-api-access-mm7hc\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007164 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-root\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007164 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007164 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-wtmp\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007164 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.007309 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kqk\" (UniqueName: \"kubernetes.io/projected/e7076beb-ed78-476e-99da-3947fd9c1f33-kube-api-access-d4kqk\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.007309 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.007209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-textfile\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.041250 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.041204 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.107558 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-wtmp\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107558 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107558 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kqk\" (UniqueName: \"kubernetes.io/projected/e7076beb-ed78-476e-99da-3947fd9c1f33-kube-api-access-d4kqk\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107652 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-wtmp\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-textfile\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7076beb-ed78-476e-99da-3947fd9c1f33-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-metrics-client-ca\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-tls\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.107816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-sys\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm7hc\" (UniqueName: \"kubernetes.io/projected/fd56f0c1-e63b-42c0-b85e-9038a3470c39-kube-api-access-mm7hc\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-root\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.107993 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-textfile\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.108011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-sys\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.108098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd56f0c1-e63b-42c0-b85e-9038a3470c39-root\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108545 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.108517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7076beb-ed78-476e-99da-3947fd9c1f33-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.108915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.108894 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.108981 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.108939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd56f0c1-e63b-42c0-b85e-9038a3470c39-metrics-client-ca\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.110364 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.110343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.110727 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.110706 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd56f0c1-e63b-42c0-b85e-9038a3470c39-node-exporter-tls\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.110865 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.110847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.110937 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.110921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7076beb-ed78-476e-99da-3947fd9c1f33-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.118344 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.118319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm7hc\" (UniqueName: \"kubernetes.io/projected/fd56f0c1-e63b-42c0-b85e-9038a3470c39-kube-api-access-mm7hc\") pod \"node-exporter-w7zbc\" (UID: \"fd56f0c1-e63b-42c0-b85e-9038a3470c39\") " pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.122515 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.122494 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kqk\" (UniqueName: \"kubernetes.io/projected/e7076beb-ed78-476e-99da-3947fd9c1f33-kube-api-access-d4kqk\") pod \"openshift-state-metrics-65f78d5c66-j4wns\" (UID: \"e7076beb-ed78-476e-99da-3947fd9c1f33\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.135354 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.135334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" Jun 11 14:21:15.147242 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.147215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.220391 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.220362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7zbc" Jun 11 14:21:15.232280 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:15.232234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd56f0c1_e63b_42c0_b85e_9038a3470c39.slice/crio-1f0a7831932b8e5500902b722ee55d33599438f9008595ac41a5aebe546d67e5 WatchSource:0}: Error finding container 1f0a7831932b8e5500902b722ee55d33599438f9008595ac41a5aebe546d67e5: Status 404 returned error can't find the container with id 1f0a7831932b8e5500902b722ee55d33599438f9008595ac41a5aebe546d67e5 Jun 11 14:21:15.241303 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.241264 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.262182 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.262155 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns"] Jun 11 14:21:15.265123 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:15.265094 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7076beb_ed78_476e_99da_3947fd9c1f33.slice/crio-4673836669f062b644feb25192806d8e0497623564f743c916308ef1d19dceb3 WatchSource:0}: Error finding container 4673836669f062b644feb25192806d8e0497623564f743c916308ef1d19dceb3: Status 404 returned error can't find the container with id 4673836669f062b644feb25192806d8e0497623564f743c916308ef1d19dceb3 Jun 11 14:21:15.345523 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.345498 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.443095 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.443061 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.707266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.707167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7zbc" event={"ID":"fd56f0c1-e63b-42c0-b85e-9038a3470c39","Type":"ContainerStarted","Data":"1f0a7831932b8e5500902b722ee55d33599438f9008595ac41a5aebe546d67e5"} Jun 11 14:21:15.709382 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.709360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" event={"ID":"e7076beb-ed78-476e-99da-3947fd9c1f33","Type":"ContainerStarted","Data":"4505992daf18ab3aa1f7c6a8624af6de05b25e9ab3795268723b963cafcfbbc5"} Jun 11 14:21:15.709496 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.709411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" event={"ID":"e7076beb-ed78-476e-99da-3947fd9c1f33","Type":"ContainerStarted","Data":"f0c20a97d3b608da6b2129034dbe2be72550262d4bffe1a424d691d861354224"} Jun 11 14:21:15.709496 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.709439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" event={"ID":"e7076beb-ed78-476e-99da-3947fd9c1f33","Type":"ContainerStarted","Data":"4673836669f062b644feb25192806d8e0497623564f743c916308ef1d19dceb3"} Jun 11 14:21:15.739705 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.739666 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:15.834646 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:15.834607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:16.214398 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.214368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:16.544207 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.544173 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-fxssc"] Jun 11 14:21:16.547543 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.547520 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:16.556514 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.556492 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 14:21:16.556795 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.556776 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 14:21:16.556884 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.556797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nrmh2\"" Jun 11 14:21:16.575597 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.575570 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fxssc"] Jun 11 14:21:16.611724 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.611670 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:16.713841 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.713816 2580 generic.go:356] "Generic (PLEG): container finished" podID="fd56f0c1-e63b-42c0-b85e-9038a3470c39" containerID="677a0eabbe3331caeb96c74a93eec9bd3c7c540c99f6cf66263cb4d6cc905180" exitCode=0 Jun 11 14:21:16.714201 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.713904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7zbc" event={"ID":"fd56f0c1-e63b-42c0-b85e-9038a3470c39","Type":"ContainerDied","Data":"677a0eabbe3331caeb96c74a93eec9bd3c7c540c99f6cf66263cb4d6cc905180"} Jun 11 14:21:16.716001 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.715967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" event={"ID":"e7076beb-ed78-476e-99da-3947fd9c1f33","Type":"ContainerStarted","Data":"baba17d6213eb1617e23d6e3fbcbb574725b8c12a9ed9760529c5d591d7eb866"} Jun 11 14:21:16.721158 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.721138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnx6x\" (UniqueName: \"kubernetes.io/projected/3268c440-9dae-46e4-83f9-41fc78246c14-kube-api-access-pnx6x\") pod \"downloads-6657875f97-fxssc\" (UID: \"3268c440-9dae-46e4-83f9-41fc78246c14\") " pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:16.793200 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.793158 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j4wns" podStartSLOduration=1.506160968 podStartE2EDuration="2.793139931s" totalImagesPullingTime="1.286978963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:16.792122185 +0000 UTC m=+238.352776574" watchObservedRunningTime="2026-06-11 14:21:16.793139931 +0000 UTC m=+238.353794323" Jun 11 14:21:16.800336 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.800277 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:16.821792 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.821756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnx6x\" (UniqueName: \"kubernetes.io/projected/3268c440-9dae-46e4-83f9-41fc78246c14-kube-api-access-pnx6x\") pod \"downloads-6657875f97-fxssc\" (UID: \"3268c440-9dae-46e4-83f9-41fc78246c14\") " pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:16.843846 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.843817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnx6x\" (UniqueName: \"kubernetes.io/projected/3268c440-9dae-46e4-83f9-41fc78246c14-kube-api-access-pnx6x\") pod \"downloads-6657875f97-fxssc\" (UID: \"3268c440-9dae-46e4-83f9-41fc78246c14\") " pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:16.858852 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.858799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:16.959755 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:16.959724 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:17.020438 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.020407 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fxssc"] Jun 11 14:21:17.024385 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:17.024364 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3268c440_9dae_46e4_83f9_41fc78246c14.slice/crio-2c56365635542bc7544a59abecae386ca9b6e5ea25a66cd5b12101288fbe33a7 WatchSource:0}: Error finding container 2c56365635542bc7544a59abecae386ca9b6e5ea25a66cd5b12101288fbe33a7: Status 404 returned error can't find the container with id 2c56365635542bc7544a59abecae386ca9b6e5ea25a66cd5b12101288fbe33a7 Jun 11 14:21:17.141676 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.141590 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:17.345003 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.344971 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:17.603603 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.603538 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:17.720774 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.720739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7zbc" event={"ID":"fd56f0c1-e63b-42c0-b85e-9038a3470c39","Type":"ContainerStarted","Data":"fe06cf1107bc1c226ac1f69601fdf9f41e283f932d2f70c79276ca59c0f234de"} Jun 11 14:21:17.721221 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.720800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7zbc" event={"ID":"fd56f0c1-e63b-42c0-b85e-9038a3470c39","Type":"ContainerStarted","Data":"b1f53d57ad2273e7c8277975eaa9a2f058a6ce9b09e2fe10c254441977b33e59"} Jun 11 14:21:17.721829 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.721808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fxssc" event={"ID":"3268c440-9dae-46e4-83f9-41fc78246c14","Type":"ContainerStarted","Data":"2c56365635542bc7544a59abecae386ca9b6e5ea25a66cd5b12101288fbe33a7"} Jun 11 14:21:17.836609 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:17.836559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w7zbc" podStartSLOduration=2.7533236690000003 podStartE2EDuration="3.836543224s" totalImagesPullingTime="1.009988658s" totalInitContainerRuntime="73.230897ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:17.829092079 +0000 UTC m=+239.389746696" watchObservedRunningTime="2026-06-11 14:21:17.836543224 +0000 UTC m=+239.397197641" Jun 11 14:21:18.335121 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:18.335083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:18.438843 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:18.438807 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:18.641109 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:18.640995 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:18.923094 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:18.922991 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:19.081244 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:19.081161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:19.666551 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:19.666513 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:19.938748 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:19.938661 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:21.869047 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:21.869008 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:24.599935 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:24.599876 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:24.701193 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:24.701152 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:27.025482 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:27.025427 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:27.117590 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:27.117543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:30.739511 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:30.739469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:21:30.741987 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:30.741960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bea2e6c-b314-4925-9a38-8bd04d7c8d5b-metrics-certs\") pod \"network-metrics-daemon-zq856\" (UID: \"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b\") " pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:21:30.757598 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:30.757565 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mz2g\"" Jun 11 14:21:30.765126 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:30.765097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq856" Jun 11 14:21:31.502899 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:31.502851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:31.666473 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:31.666432 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:34.246280 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.246248 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zq856"] Jun 11 14:21:34.249144 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:21:34.249118 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bea2e6c_b314_4925_9a38_8bd04d7c8d5b.slice/crio-54768e68d72967c84ebb4511e79ead1eba54191b60e7ef2a50ffa625ac5deb36 WatchSource:0}: Error finding container 54768e68d72967c84ebb4511e79ead1eba54191b60e7ef2a50ffa625ac5deb36: Status 404 returned error can't find the container with id 54768e68d72967c84ebb4511e79ead1eba54191b60e7ef2a50ffa625ac5deb36 Jun 11 14:21:34.786433 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.786389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fxssc" event={"ID":"3268c440-9dae-46e4-83f9-41fc78246c14","Type":"ContainerStarted","Data":"4ee4380a2dd55f36bd47d260e222ad8e7ad50e918e95b9d41f6d6a8ce155868d"} Jun 11 14:21:34.786740 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.786714 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:34.788451 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.788426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq856" event={"ID":"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b","Type":"ContainerStarted","Data":"54768e68d72967c84ebb4511e79ead1eba54191b60e7ef2a50ffa625ac5deb36"} Jun 11 14:21:34.796410 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.796353 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-fxssc" Jun 11 14:21:34.818585 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:34.818515 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-fxssc" podStartSLOduration=1.297425086 podStartE2EDuration="18.818495048s" totalImagesPullingTime="17.521069962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:34.817528891 +0000 UTC m=+256.378183279" watchObservedRunningTime="2026-06-11 14:21:34.818495048 +0000 UTC m=+256.379149438" Jun 11 14:21:35.186485 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.186448 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:35.288764 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.288655 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:35.795995 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.795954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq856" event={"ID":"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b","Type":"ContainerStarted","Data":"51fbef876d31248d01ce0d732a98d3556effdb5c70efff568bfb076d3daa31bc"} Jun 11 14:21:35.796197 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.796025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq856" event={"ID":"4bea2e6c-b314-4925-9a38-8bd04d7c8d5b","Type":"ContainerStarted","Data":"b327bfc715e8a6b1f99c2e850296c52d1320e9444aa1c9717117019c79f115d5"} Jun 11 14:21:35.829486 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.829432 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zq856" podStartSLOduration=255.949878822 podStartE2EDuration="4m16.829414175s" totalImagesPullingTime="879.535353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:35.828938745 +0000 UTC m=+257.389593133" watchObservedRunningTime="2026-06-11 14:21:35.829414175 +0000 UTC m=+257.390068566" Jun 11 14:21:35.830729 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.830692 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:35.969359 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:35.969301 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:36.072648 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:36.072568 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:36.214430 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:36.214373 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:44.666948 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:44.666845 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:44.761870 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:44.761835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:45.015686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:45.015603 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:45.113152 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:45.113120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:47.397564 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:47.397525 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" podUID="079a494f-0007-4f63-a30c-3ed331d2aaee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:21:52.683053 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:52.683011 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:52.782546 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:52.782509 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:53.603639 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:53.603611 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/init-textfile/0.log" Jun 11 14:21:53.804726 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:53.804699 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/node-exporter/0.log" Jun 11 14:21:54.003110 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.003009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/kube-rbac-proxy/0.log" Jun 11 14:21:54.203063 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.203013 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/kube-rbac-proxy-main/0.log" Jun 11 14:21:54.403289 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.403261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/kube-rbac-proxy-self/0.log" Jun 11 14:21:54.560831 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.560791 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:54.604467 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.604442 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/openshift-state-metrics/0.log" Jun 11 14:21:54.660747 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:54.660661 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:56.318348 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:56.318322 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:56.603922 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:56.603834 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kfzmw_37611ace-4989-4a58-aff4-bf1df7359629/prometheus-operator-admission-webhook/0.log" Jun 11 14:21:57.397930 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:57.397896 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" podUID="079a494f-0007-4f63-a30c-3ed331d2aaee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:21:57.627003 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:57.626963 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:21:59.605871 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:21:59.605845 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-fxssc_3268c440-9dae-46e4-83f9-41fc78246c14/download-server/0.log" Jun 11 14:22:01.186701 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:01.186661 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:01.202753 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:01.202723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm2zr_32a1d6ee-a64c-40eb-aaca-44a2ed3daef3/dns-node-resolver/0.log" Jun 11 14:22:01.239103 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:01.239066 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:01.485021 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:22:01.484933 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nkpqz" podUID="915a2b77-149f-4202-89ff-62b9c6283997" Jun 11 14:22:01.885393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:01.885364 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:02.046099 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:02.046065 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:02.403093 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:02.403066 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nsjmk_0a7d6e05-4f94-4bfe-974f-d29eb0acbead/node-ca/0.log" Jun 11 14:22:03.202746 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:03.202722 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlh89_a480903b-60e9-4366-a942-e59914f55f9b/serve-healthcheck-canary/0.log" Jun 11 14:22:04.813772 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:04.813740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:04.816316 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:04.816290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/915a2b77-149f-4202-89ff-62b9c6283997-metrics-tls\") pod \"dns-default-nkpqz\" (UID: \"915a2b77-149f-4202-89ff-62b9c6283997\") " pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:04.888867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:04.888836 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw4vr\"" Jun 11 14:22:04.896920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:04.896892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:05.030476 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.029915 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.083925 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.083842 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nkpqz"] Jun 11 14:22:05.086381 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.086336 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.088606 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:22:05.088568 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915a2b77_149f_4202_89ff_62b9c6283997.slice/crio-b0ab13ca9842786f4db5a69c1aa2433b6b78d74fa16fd23c16833f180b85e199 WatchSource:0}: Error finding container b0ab13ca9842786f4db5a69c1aa2433b6b78d74fa16fd23c16833f180b85e199: Status 404 returned error can't find the container with id b0ab13ca9842786f4db5a69c1aa2433b6b78d74fa16fd23c16833f180b85e199 Jun 11 14:22:05.178331 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.178300 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.276965 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.276931 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.505298 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.505180 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.620229 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.620142 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:05.901758 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:05.901643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nkpqz" event={"ID":"915a2b77-149f-4202-89ff-62b9c6283997","Type":"ContainerStarted","Data":"b0ab13ca9842786f4db5a69c1aa2433b6b78d74fa16fd23c16833f180b85e199"} Jun 11 14:22:07.397922 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.397874 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" podUID="079a494f-0007-4f63-a30c-3ed331d2aaee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:22:07.398388 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.397962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" Jun 11 14:22:07.398599 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.398563 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"32e6a4e0a9bfd9957ef2bd316c87159d33af676130327b7609b31638a0245a37"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 14:22:07.398687 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.398628 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" podUID="079a494f-0007-4f63-a30c-3ed331d2aaee" containerName="service-proxy" containerID="cri-o://32e6a4e0a9bfd9957ef2bd316c87159d33af676130327b7609b31638a0245a37" gracePeriod=30 Jun 11 14:22:07.670338 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.670256 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:07.770249 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.770208 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:07.870542 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.870512 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:07.910672 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.910644 2580 generic.go:356] "Generic (PLEG): container finished" podID="079a494f-0007-4f63-a30c-3ed331d2aaee" containerID="32e6a4e0a9bfd9957ef2bd316c87159d33af676130327b7609b31638a0245a37" exitCode=2 Jun 11 14:22:07.910821 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.910694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerDied","Data":"32e6a4e0a9bfd9957ef2bd316c87159d33af676130327b7609b31638a0245a37"} Jun 11 14:22:07.910821 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:07.910734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c69759ff7-bjv52" event={"ID":"079a494f-0007-4f63-a30c-3ed331d2aaee","Type":"ContainerStarted","Data":"9fe95d9add3fe0c04208851d816e4d92ef9ab2637d305672f79d3a7484cbd713"} Jun 11 14:22:08.915919 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:08.915885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nkpqz" event={"ID":"915a2b77-149f-4202-89ff-62b9c6283997","Type":"ContainerStarted","Data":"d67ba5df39e81be296a15a7f595a51f9bb1f87ab6705b56fe0f6ba7074d52630"} Jun 11 14:22:08.916371 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:08.915983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nkpqz" event={"ID":"915a2b77-149f-4202-89ff-62b9c6283997","Type":"ContainerStarted","Data":"6e3b5f5cb220cb4bfd84e11ff5f692018cfad6f5465390ca5c5e580a9c34a08a"} Jun 11 14:22:08.916371 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:08.916013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:08.933437 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:08.933387 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nkpqz" podStartSLOduration=252.241268199 podStartE2EDuration="4m14.933371767s" totalImagesPullingTime="2.692103568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:22:08.932497067 +0000 UTC m=+290.493151456" watchObservedRunningTime="2026-06-11 14:22:08.933371767 +0000 UTC m=+290.494026156" Jun 11 14:22:09.088512 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:09.088477 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:09.189650 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:09.189575 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:11.509731 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:11.509695 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:11.571886 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:11.571850 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:13.638633 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:13.638594 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:13.695258 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:13.695230 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:15.047099 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:15.047056 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:15.147742 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:15.147710 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:15.199320 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:15.199281 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:18.908923 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:18.908891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:22:18.909383 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:18.909190 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:22:18.919576 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:18.919551 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:22:18.922530 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:18.922507 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nkpqz" Jun 11 14:22:22.730913 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:22.730861 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:22.834625 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:22.834584 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:28.088404 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:28.088368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:28.190351 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:28.190320 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:31.513110 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:31.513063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:31.569286 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:31.569252 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:32.688500 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:32.688465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:32.749639 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:32.749606 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:35.581578 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:35.581540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:35.632013 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:35.631983 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:37.678308 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:37.678263 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:37.779172 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:37.779126 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:38.062365 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:38.062317 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:38.137830 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:38.137782 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:46.614579 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:46.614544 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:46.713841 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:46.713807 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:46.779745 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:46.779712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:52.683832 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:52.683765 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:22:52.782478 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:22:52.782444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:23:17.861211 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:23:17.861120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:23:17.939488 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:23:17.939444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:23:38.337851 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:23:38.337810 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:23:38.432000 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:23:38.431961 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:05.099742 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:05.099700 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:05.964465 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:05.964432 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:08.742847 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:08.742809 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:08.807006 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:08.806966 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:10.229545 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:10.229499 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:10.504728 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:10.504610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:10.621699 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:10.621664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:11.386248 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:11.386215 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:11.526417 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:11.526383 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:13.765225 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:13.765176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:14.359364 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:14.359332 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:15.698625 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:15.698592 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:15.802920 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:15.802894 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:18.214379 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.214343 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd"] Jun 11 14:24:18.216177 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.216162 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.220239 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.220213 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:24:18.220345 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.220318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:24:18.224524 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.224507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h6dn8\"" Jun 11 14:24:18.235482 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.235459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd"] Jun 11 14:24:18.335782 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.335736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9t4g\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-kube-api-access-d9t4g\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.335782 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.335782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.436422 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.436382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9t4g\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-kube-api-access-d9t4g\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.436422 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.436425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.444234 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.444199 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.444425 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.444405 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9t4g\" (UniqueName: \"kubernetes.io/projected/da249471-ece7-4c5d-9f05-dee83e2c87cc-kube-api-access-d9t4g\") pod \"cert-manager-cainjector-5d99449ffd-8fjvd\" (UID: \"da249471-ece7-4c5d-9f05-dee83e2c87cc\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.524876 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.524803 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" Jun 11 14:24:18.649567 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.649536 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd"] Jun 11 14:24:18.652639 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:24:18.652610 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda249471_ece7_4c5d_9f05_dee83e2c87cc.slice/crio-38abce01f9ff1018695a7e24debdca61faa1f36eb60deb0e0c42d33632e8647b WatchSource:0}: Error finding container 38abce01f9ff1018695a7e24debdca61faa1f36eb60deb0e0c42d33632e8647b: Status 404 returned error can't find the container with id 38abce01f9ff1018695a7e24debdca61faa1f36eb60deb0e0c42d33632e8647b Jun 11 14:24:18.654494 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:18.654477 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:24:19.347222 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:19.347188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" event={"ID":"da249471-ece7-4c5d-9f05-dee83e2c87cc","Type":"ContainerStarted","Data":"38abce01f9ff1018695a7e24debdca61faa1f36eb60deb0e0c42d33632e8647b"} Jun 11 14:24:22.362254 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:22.362205 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" event={"ID":"da249471-ece7-4c5d-9f05-dee83e2c87cc","Type":"ContainerStarted","Data":"b3bb40142ee525a00eaa09a707aa81bcf5007cd52455a2a958b044068b047ff7"} Jun 11 14:24:22.371789 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:22.371757 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:22.377537 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:22.377487 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8fjvd" podStartSLOduration=1.302104532 podStartE2EDuration="4.377468768s" totalImagesPullingTime="3.075364236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:22.377112984 +0000 UTC m=+423.937767375" watchObservedRunningTime="2026-06-11 14:24:22.377468768 +0000 UTC m=+423.938123160" Jun 11 14:24:22.470779 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:22.470739 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:27.910714 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:27.910679 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:28.008882 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:28.008838 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:30.130153 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.130118 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7"] Jun 11 14:24:30.133298 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.133282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.135505 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.135483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 14:24:30.136273 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.136257 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-59nrr\"" Jun 11 14:24:30.136367 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.136274 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:24:30.140947 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.140927 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7"] Jun 11 14:24:30.228682 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.228640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0136b045-bb07-4814-9a22-67eb5b5bc26b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.228853 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.228707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd4k\" (UniqueName: \"kubernetes.io/projected/0136b045-bb07-4814-9a22-67eb5b5bc26b-kube-api-access-pzd4k\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.329969 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.329924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd4k\" (UniqueName: \"kubernetes.io/projected/0136b045-bb07-4814-9a22-67eb5b5bc26b-kube-api-access-pzd4k\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.330116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.329985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0136b045-bb07-4814-9a22-67eb5b5bc26b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.330420 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.330399 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0136b045-bb07-4814-9a22-67eb5b5bc26b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.338723 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.338689 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd4k\" (UniqueName: \"kubernetes.io/projected/0136b045-bb07-4814-9a22-67eb5b5bc26b-kube-api-access-pzd4k\") pod \"openshift-lws-operator-fd8ccff4c-2jjs7\" (UID: \"0136b045-bb07-4814-9a22-67eb5b5bc26b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.443013 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.442919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" Jun 11 14:24:30.574308 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:30.574273 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7"] Jun 11 14:24:30.577592 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:24:30.577565 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0136b045_bb07_4814_9a22_67eb5b5bc26b.slice/crio-b3fa1719b20cb97ad0307ec94ec1ac94329fa71c3bc12878a8a2362dd34b0a72 WatchSource:0}: Error finding container b3fa1719b20cb97ad0307ec94ec1ac94329fa71c3bc12878a8a2362dd34b0a72: Status 404 returned error can't find the container with id b3fa1719b20cb97ad0307ec94ec1ac94329fa71c3bc12878a8a2362dd34b0a72 Jun 11 14:24:31.310925 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.310886 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-b44r5"] Jun 11 14:24:31.315163 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.315144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.317528 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.317504 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-485fm\"" Jun 11 14:24:31.329804 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.329768 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-b44r5"] Jun 11 14:24:31.337954 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.337926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-bound-sa-token\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.338092 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.337960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntp5k\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-kube-api-access-ntp5k\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.394347 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.394306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" event={"ID":"0136b045-bb07-4814-9a22-67eb5b5bc26b","Type":"ContainerStarted","Data":"b3fa1719b20cb97ad0307ec94ec1ac94329fa71c3bc12878a8a2362dd34b0a72"} Jun 11 14:24:31.438801 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.438760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-bound-sa-token\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.438801 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.438806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntp5k\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-kube-api-access-ntp5k\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.451451 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.451424 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-bound-sa-token\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.451891 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.451873 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntp5k\" (UniqueName: \"kubernetes.io/projected/aeff301d-ba2e-48d6-aa3c-f3f0408d3550-kube-api-access-ntp5k\") pod \"cert-manager-59c77684cc-b44r5\" (UID: \"aeff301d-ba2e-48d6-aa3c-f3f0408d3550\") " pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.624827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.624714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-b44r5" Jun 11 14:24:31.784733 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:31.784690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-b44r5"] Jun 11 14:24:31.787955 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:24:31.787925 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeff301d_ba2e_48d6_aa3c_f3f0408d3550.slice/crio-5f571aa9ffda5d3c89d4039eb014c040542cab3315fe33f7bf989f0d9b736c3d WatchSource:0}: Error finding container 5f571aa9ffda5d3c89d4039eb014c040542cab3315fe33f7bf989f0d9b736c3d: Status 404 returned error can't find the container with id 5f571aa9ffda5d3c89d4039eb014c040542cab3315fe33f7bf989f0d9b736c3d Jun 11 14:24:32.400222 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:32.400185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-b44r5" event={"ID":"aeff301d-ba2e-48d6-aa3c-f3f0408d3550","Type":"ContainerStarted","Data":"60809aa042a5fa8672f71b8c710d8a398670c372af8feee83394c5010d19ba69"} Jun 11 14:24:32.400686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:32.400232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-b44r5" event={"ID":"aeff301d-ba2e-48d6-aa3c-f3f0408d3550","Type":"ContainerStarted","Data":"5f571aa9ffda5d3c89d4039eb014c040542cab3315fe33f7bf989f0d9b736c3d"} Jun 11 14:24:32.417392 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:32.417332 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-b44r5" podStartSLOduration=1.417313879 podStartE2EDuration="1.417313879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:32.417017991 +0000 UTC m=+433.977672380" watchObservedRunningTime="2026-06-11 14:24:32.417313879 +0000 UTC m=+433.977968269" Jun 11 14:24:34.408712 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:34.408675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" event={"ID":"0136b045-bb07-4814-9a22-67eb5b5bc26b","Type":"ContainerStarted","Data":"cc846ce4d95f811bacfe21ceecf758e40d5c9deb741bfef6ec3e47b43e7b1dbd"} Jun 11 14:24:34.426728 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:34.426679 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2jjs7" podStartSLOduration=1.647591786 podStartE2EDuration="4.426661711s" totalImagesPullingTime="2.779069925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:34.426323852 +0000 UTC m=+435.986978241" watchObservedRunningTime="2026-06-11 14:24:34.426661711 +0000 UTC m=+435.987316100" Jun 11 14:24:35.187876 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:35.187846 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:35.284230 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:35.284189 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:37.053656 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:37.053617 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:48.919367 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:48.919329 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:49.018439 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:49.018407 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:49.579595 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:49.579564 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:49.839059 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:49.838953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:49.948067 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:49.948008 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.001350 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.001316 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv"] Jun 11 14:24:50.004738 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.004718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.007533 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.007511 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:24:50.007766 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.007752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xq4s9\"" Jun 11 14:24:50.008466 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.008449 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:24:50.008986 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.008971 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:24:50.009256 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.009243 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:24:50.023198 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.023160 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv"] Jun 11 14:24:50.081051 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.081008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.081272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.081074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.081272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.081134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.081272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.081170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.081272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.081226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54ps\" (UniqueName: \"kubernetes.io/projected/2a99af8d-99ec-4080-afc3-333f5dc96487-kube-api-access-b54ps\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.111508 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.111431 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.182308 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b54ps\" (UniqueName: \"kubernetes.io/projected/2a99af8d-99ec-4080-afc3-333f5dc96487-kube-api-access-b54ps\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.182494 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.182494 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.182615 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.182615 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.182929 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.182905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.184823 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.184796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a99af8d-99ec-4080-afc3-333f5dc96487-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.185168 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.185145 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.185220 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.185155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a99af8d-99ec-4080-afc3-333f5dc96487-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.195297 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.195272 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54ps\" (UniqueName: \"kubernetes.io/projected/2a99af8d-99ec-4080-afc3-333f5dc96487-kube-api-access-b54ps\") pod \"opendatahub-operator-controller-manager-85855677f7-888kv\" (UID: \"2a99af8d-99ec-4080-afc3-333f5dc96487\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.211968 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.211935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.314646 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.314611 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:50.317427 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.317398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.440470 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.440432 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.447550 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.447522 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv"] Jun 11 14:24:50.450469 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:24:50.450444 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a99af8d_99ec_4080_afc3_333f5dc96487.slice/crio-5578b4bebcc0ff77fbf161eb47c78d66ca7e571450f19c876be8e3a1b1c2261a WatchSource:0}: Error finding container 5578b4bebcc0ff77fbf161eb47c78d66ca7e571450f19c876be8e3a1b1c2261a: Status 404 returned error can't find the container with id 5578b4bebcc0ff77fbf161eb47c78d66ca7e571450f19c876be8e3a1b1c2261a Jun 11 14:24:50.466436 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.466411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" event={"ID":"2a99af8d-99ec-4080-afc3-333f5dc96487","Type":"ContainerStarted","Data":"5578b4bebcc0ff77fbf161eb47c78d66ca7e571450f19c876be8e3a1b1c2261a"} Jun 11 14:24:50.539726 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.539694 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:50.640915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:50.640816 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:24:54.485575 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:54.485516 2580 generic.go:356] "Generic (PLEG): container finished" podID="2a99af8d-99ec-4080-afc3-333f5dc96487" containerID="1f53499069d415d188983b3c678e58a115b1c1721c1974e80e3aa90caba779d5" exitCode=0 Jun 11 14:24:54.485945 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:54.485599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" event={"ID":"2a99af8d-99ec-4080-afc3-333f5dc96487","Type":"ContainerDied","Data":"1f53499069d415d188983b3c678e58a115b1c1721c1974e80e3aa90caba779d5"} Jun 11 14:24:55.491216 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:55.491185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" event={"ID":"2a99af8d-99ec-4080-afc3-333f5dc96487","Type":"ContainerStarted","Data":"4f5ae37d30656624d35bdb2e781b2753125fa712f915f21bdd7952b0d721ae94"} Jun 11 14:24:55.491584 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:55.491314 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:24:55.513376 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:24:55.513317 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" podStartSLOduration=2.194134611 podStartE2EDuration="6.51329443s" totalImagesPullingTime="3.403126398s" totalInitContainerRuntime="916.033421ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:55.510911911 +0000 UTC m=+457.071566330" watchObservedRunningTime="2026-06-11 14:24:55.51329443 +0000 UTC m=+457.073948819" Jun 11 14:25:05.597534 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:05.597503 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:05.708416 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:05.708380 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:06.498187 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:06.498155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-888kv" Jun 11 14:25:08.845520 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:08.845487 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:09.029013 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.028972 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:09.593516 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.593477 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n26bk"] Jun 11 14:25:09.596664 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.596646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:09.601535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.601512 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gfdhr\"" Jun 11 14:25:09.601863 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.601843 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 14:25:09.610670 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.610645 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n26bk"] Jun 11 14:25:09.686172 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.686143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:09.740535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.740491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6r9t\" (UniqueName: \"kubernetes.io/projected/29993c28-22b1-4ff1-a066-7d88dd1dbec5-kube-api-access-t6r9t\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:09.740697 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.740619 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:09.779412 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.779378 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:09.841608 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.841563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6r9t\" (UniqueName: \"kubernetes.io/projected/29993c28-22b1-4ff1-a066-7d88dd1dbec5-kube-api-access-t6r9t\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:09.841807 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.841735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:09.841879 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:25:09.841854 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 14:25:09.841927 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:25:09.841903 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert podName:29993c28-22b1-4ff1-a066-7d88dd1dbec5 nodeName:}" failed. No retries permitted until 2026-06-11 14:25:10.341887789 +0000 UTC m=+471.902542157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert") pod "odh-model-controller-6dc94f689f-n26bk" (UID: "29993c28-22b1-4ff1-a066-7d88dd1dbec5") : secret "odh-model-controller-webhook-cert" not found Jun 11 14:25:09.859839 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:09.859765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6r9t\" (UniqueName: \"kubernetes.io/projected/29993c28-22b1-4ff1-a066-7d88dd1dbec5-kube-api-access-t6r9t\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:10.006902 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.006856 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.269269 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.269191 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.346205 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.346171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:10.349299 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.349265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29993c28-22b1-4ff1-a066-7d88dd1dbec5-cert\") pod \"odh-model-controller-6dc94f689f-n26bk\" (UID: \"29993c28-22b1-4ff1-a066-7d88dd1dbec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:10.390099 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.390066 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.400787 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.400761 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rm229"] Jun 11 14:25:10.405381 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.405362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.407529 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.407506 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 14:25:10.420576 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.420550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rm229"] Jun 11 14:25:10.480685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.480647 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.507219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.507182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:10.547337 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.547298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f42549-1a4e-47fa-b628-73554a693756-tls-certs\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.547521 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.547502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjtn\" (UniqueName: \"kubernetes.io/projected/f7f42549-1a4e-47fa-b628-73554a693756-kube-api-access-xtjtn\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.564881 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.564817 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.571259 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.571224 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj"] Jun 11 14:25:10.575437 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.575409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.580147 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.579752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 14:25:10.580147 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.579873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xq5g4\"" Jun 11 14:25:10.580147 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.579911 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 14:25:10.580147 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.580029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:25:10.580342 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.580264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:25:10.589366 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.589346 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj"] Jun 11 14:25:10.647683 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.647647 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:10.647903 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.647881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f42549-1a4e-47fa-b628-73554a693756-tls-certs\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.647982 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.647924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndwk5\" (UniqueName: \"kubernetes.io/projected/15384b62-7655-4420-9792-743943bfecf9-kube-api-access-ndwk5\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.647982 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.647974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15384b62-7655-4420-9792-743943bfecf9-tls-certs\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.648112 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.648095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjtn\" (UniqueName: \"kubernetes.io/projected/f7f42549-1a4e-47fa-b628-73554a693756-kube-api-access-xtjtn\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.648165 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.648126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15384b62-7655-4420-9792-743943bfecf9-tmp\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.650474 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.650450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7f42549-1a4e-47fa-b628-73554a693756-tls-certs\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.653449 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.653426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n26bk"] Jun 11 14:25:10.659634 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:10.659583 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29993c28_22b1_4ff1_a066_7d88dd1dbec5.slice/crio-f5c8da18b6f168edc56e468717fa8e4885057252112ea7c6f5152ef0322aef36 WatchSource:0}: Error finding container f5c8da18b6f168edc56e468717fa8e4885057252112ea7c6f5152ef0322aef36: Status 404 returned error can't find the container with id f5c8da18b6f168edc56e468717fa8e4885057252112ea7c6f5152ef0322aef36 Jun 11 14:25:10.659932 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.659914 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjtn\" (UniqueName: \"kubernetes.io/projected/f7f42549-1a4e-47fa-b628-73554a693756-kube-api-access-xtjtn\") pod \"model-serving-api-5dd488fc48-rm229\" (UID: \"f7f42549-1a4e-47fa-b628-73554a693756\") " pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.715734 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.715696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:10.748807 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.748772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15384b62-7655-4420-9792-743943bfecf9-tmp\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.748966 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.748827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndwk5\" (UniqueName: \"kubernetes.io/projected/15384b62-7655-4420-9792-743943bfecf9-kube-api-access-ndwk5\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.748966 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.748869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15384b62-7655-4420-9792-743943bfecf9-tls-certs\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.751116 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.751094 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15384b62-7655-4420-9792-743943bfecf9-tmp\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.751474 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.751452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15384b62-7655-4420-9792-743943bfecf9-tls-certs\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.757096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.757062 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndwk5\" (UniqueName: \"kubernetes.io/projected/15384b62-7655-4420-9792-743943bfecf9-kube-api-access-ndwk5\") pod \"kube-auth-proxy-59d5469cdd-mxdxj\" (UID: \"15384b62-7655-4420-9792-743943bfecf9\") " pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:10.848892 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.848863 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-rm229"] Jun 11 14:25:10.851383 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:10.851339 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f42549_1a4e_47fa_b628_73554a693756.slice/crio-b08bff2c77ba53cf5a9d27f1f83c0a7b16476d87e57066aba932c95a518e9eef WatchSource:0}: Error finding container b08bff2c77ba53cf5a9d27f1f83c0a7b16476d87e57066aba932c95a518e9eef: Status 404 returned error can't find the container with id b08bff2c77ba53cf5a9d27f1f83c0a7b16476d87e57066aba932c95a518e9eef Jun 11 14:25:10.885754 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:10.885721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" Jun 11 14:25:11.021248 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:11.021217 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj"] Jun 11 14:25:11.025525 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:11.025487 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15384b62_7655_4420_9792_743943bfecf9.slice/crio-c3d8f4849506ce997302111a9087442235e1d9131c26c90e3d9992db3262e606 WatchSource:0}: Error finding container c3d8f4849506ce997302111a9087442235e1d9131c26c90e3d9992db3262e606: Status 404 returned error can't find the container with id c3d8f4849506ce997302111a9087442235e1d9131c26c90e3d9992db3262e606 Jun 11 14:25:11.554595 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:11.554556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" event={"ID":"29993c28-22b1-4ff1-a066-7d88dd1dbec5","Type":"ContainerStarted","Data":"f5c8da18b6f168edc56e468717fa8e4885057252112ea7c6f5152ef0322aef36"} Jun 11 14:25:11.557859 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:11.557826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" event={"ID":"15384b62-7655-4420-9792-743943bfecf9","Type":"ContainerStarted","Data":"c3d8f4849506ce997302111a9087442235e1d9131c26c90e3d9992db3262e606"} Jun 11 14:25:11.559597 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:11.559570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rm229" event={"ID":"f7f42549-1a4e-47fa-b628-73554a693756","Type":"ContainerStarted","Data":"b08bff2c77ba53cf5a9d27f1f83c0a7b16476d87e57066aba932c95a518e9eef"} Jun 11 14:25:16.591346 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.591314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" event={"ID":"29993c28-22b1-4ff1-a066-7d88dd1dbec5","Type":"ContainerStarted","Data":"76e805ed5128ba96cafefcd3903865cc5abd55f87d311b8a9afdf3da93530581"} Jun 11 14:25:16.591762 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.591410 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:16.592727 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.592708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" event={"ID":"15384b62-7655-4420-9792-743943bfecf9","Type":"ContainerStarted","Data":"c716877cb95ea147c5ed1ca51551cc0187e9df2ac726a99ea25cb065ae9b1121"} Jun 11 14:25:16.594052 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.594017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-rm229" event={"ID":"f7f42549-1a4e-47fa-b628-73554a693756","Type":"ContainerStarted","Data":"2707abe2b9b6981737bca44c1dd12cc30d12da58e4e41ac8e2fe7c48299cc51e"} Jun 11 14:25:16.594178 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.594159 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:16.607016 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.606966 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" podStartSLOduration=2.373013369 podStartE2EDuration="7.606950161s" totalImagesPullingTime="5.233936792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:16.60628624 +0000 UTC m=+478.166940641" watchObservedRunningTime="2026-06-11 14:25:16.606950161 +0000 UTC m=+478.167604551" Jun 11 14:25:16.622865 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.622817 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59d5469cdd-mxdxj" podStartSLOduration=1.740956303 podStartE2EDuration="6.622802689s" totalImagesPullingTime="4.881846386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:16.621901738 +0000 UTC m=+478.182556128" watchObservedRunningTime="2026-06-11 14:25:16.622802689 +0000 UTC m=+478.183457079" Jun 11 14:25:16.638795 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:16.638745 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-rm229" podStartSLOduration=1.5894715339999999 podStartE2EDuration="6.638727621s" totalImagesPullingTime="5.049256087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:16.637224888 +0000 UTC m=+478.197879268" watchObservedRunningTime="2026-06-11 14:25:16.638727621 +0000 UTC m=+478.199382046" Jun 11 14:25:20.856333 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.856295 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:20.896683 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.896649 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z872g"] Jun 11 14:25:20.901266 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.901247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:20.903760 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.903737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 14:25:20.903877 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.903767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xhrl9\"" Jun 11 14:25:20.917653 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.917618 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4"] Jun 11 14:25:20.920724 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.920707 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z872g"] Jun 11 14:25:20.920801 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.920792 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:20.923191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.923168 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g4v8x\"" Jun 11 14:25:20.923761 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.923741 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 14:25:20.935451 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.935427 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4"] Jun 11 14:25:20.943579 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:20.943543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:21.040468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.040434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45fb5ff-495b-4109-9828-c48e2c960d3f-cert\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.040632 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.040480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/441bbe20-ff15-4de9-9fac-58ff48fb2e75-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.040632 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.040565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz26r\" (UniqueName: \"kubernetes.io/projected/a45fb5ff-495b-4109-9828-c48e2c960d3f-kube-api-access-mz26r\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.040632 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.040597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lx74\" (UniqueName: \"kubernetes.io/projected/441bbe20-ff15-4de9-9fac-58ff48fb2e75-kube-api-access-9lx74\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.100686 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.100646 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:21.141395 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.141312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lx74\" (UniqueName: \"kubernetes.io/projected/441bbe20-ff15-4de9-9fac-58ff48fb2e75-kube-api-access-9lx74\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.141395 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.141352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45fb5ff-495b-4109-9828-c48e2c960d3f-cert\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.141395 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.141378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/441bbe20-ff15-4de9-9fac-58ff48fb2e75-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.141667 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.141432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz26r\" (UniqueName: \"kubernetes.io/projected/a45fb5ff-495b-4109-9828-c48e2c960d3f-kube-api-access-mz26r\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.143753 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.143727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45fb5ff-495b-4109-9828-c48e2c960d3f-cert\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.143870 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.143806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/441bbe20-ff15-4de9-9fac-58ff48fb2e75-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.172018 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.171989 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz26r\" (UniqueName: \"kubernetes.io/projected/a45fb5ff-495b-4109-9828-c48e2c960d3f-kube-api-access-mz26r\") pod \"kserve-controller-manager-69fc866d76-z872g\" (UID: \"a45fb5ff-495b-4109-9828-c48e2c960d3f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.172895 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.172873 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lx74\" (UniqueName: \"kubernetes.io/projected/441bbe20-ff15-4de9-9fac-58ff48fb2e75-kube-api-access-9lx74\") pod \"llmisvc-controller-manager-864bfd7bc9-6r5t4\" (UID: \"441bbe20-ff15-4de9-9fac-58ff48fb2e75\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.210783 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.210750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:21.230788 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.230748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:21.232154 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.232120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:21.350648 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.350608 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z872g"] Jun 11 14:25:21.353319 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:21.353290 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45fb5ff_495b_4109_9828_c48e2c960d3f.slice/crio-987f8b0af9729add947923c7b8be890eb678b3f0fe49c9760b0ef79811af4d09 WatchSource:0}: Error finding container 987f8b0af9729add947923c7b8be890eb678b3f0fe49c9760b0ef79811af4d09: Status 404 returned error can't find the container with id 987f8b0af9729add947923c7b8be890eb678b3f0fe49c9760b0ef79811af4d09 Jun 11 14:25:21.369849 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.369826 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4"] Jun 11 14:25:21.372177 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:21.372151 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod441bbe20_ff15_4de9_9fac_58ff48fb2e75.slice/crio-832c3d15995e6ea744812e8e1758198e31bafec484a8669b81623da8234b651e WatchSource:0}: Error finding container 832c3d15995e6ea744812e8e1758198e31bafec484a8669b81623da8234b651e: Status 404 returned error can't find the container with id 832c3d15995e6ea744812e8e1758198e31bafec484a8669b81623da8234b651e Jun 11 14:25:21.615719 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.615685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" event={"ID":"a45fb5ff-495b-4109-9828-c48e2c960d3f","Type":"ContainerStarted","Data":"987f8b0af9729add947923c7b8be890eb678b3f0fe49c9760b0ef79811af4d09"} Jun 11 14:25:21.616786 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:21.616765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" event={"ID":"441bbe20-ff15-4de9-9fac-58ff48fb2e75","Type":"ContainerStarted","Data":"832c3d15995e6ea744812e8e1758198e31bafec484a8669b81623da8234b651e"} Jun 11 14:25:22.129593 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:22.129554 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:22.266244 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:22.266210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:23.431896 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:23.431855 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:23.540735 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:23.540687 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:25.113183 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.113147 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:25.217152 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.217115 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:25.408999 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.408922 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:25.637550 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.637512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" event={"ID":"441bbe20-ff15-4de9-9fac-58ff48fb2e75","Type":"ContainerStarted","Data":"a7c155148b7a030ab76c4030ea632cece57f29e093c98871fded985bea28f77b"} Jun 11 14:25:25.637731 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.637612 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:25.639088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.639066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" event={"ID":"a45fb5ff-495b-4109-9828-c48e2c960d3f","Type":"ContainerStarted","Data":"46fd0bce8c4d61a31a94463159c26ba6febfda9e8117df148d20efef88a711b5"} Jun 11 14:25:25.639206 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.639168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:25:25.676240 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.676153 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" podStartSLOduration=2.275310366 podStartE2EDuration="5.676137372s" totalImagesPullingTime="3.400827006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:25.670572422 +0000 UTC m=+487.231226811" watchObservedRunningTime="2026-06-11 14:25:25.676137372 +0000 UTC m=+487.236791761" Jun 11 14:25:25.722617 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:25.722556 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" podStartSLOduration=2.307453005 podStartE2EDuration="5.722532957s" totalImagesPullingTime="3.415079952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:25.721407414 +0000 UTC m=+487.282061804" watchObservedRunningTime="2026-06-11 14:25:25.722532957 +0000 UTC m=+487.283187347" Jun 11 14:25:26.077526 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:26.077493 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:26.417533 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:26.417441 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:27.600835 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:27.600800 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-n26bk" Jun 11 14:25:27.602740 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:27.602715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-rm229" Jun 11 14:25:28.160134 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.160097 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc"] Jun 11 14:25:28.163472 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.163453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.170512 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.170490 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 14:25:28.172763 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.172745 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-htjlk\"" Jun 11 14:25:28.172860 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.172822 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 14:25:28.201393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.201356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5786bddc-3e31-4279-ac8e-bde368ed7f6b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.201393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.201393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ssc\" (UniqueName: \"kubernetes.io/projected/5786bddc-3e31-4279-ac8e-bde368ed7f6b-kube-api-access-z8ssc\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.252087 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.252057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc"] Jun 11 14:25:28.302598 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.302558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5786bddc-3e31-4279-ac8e-bde368ed7f6b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.302790 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.302606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ssc\" (UniqueName: \"kubernetes.io/projected/5786bddc-3e31-4279-ac8e-bde368ed7f6b-kube-api-access-z8ssc\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.305119 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.305096 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5786bddc-3e31-4279-ac8e-bde368ed7f6b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.313404 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.313379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ssc\" (UniqueName: \"kubernetes.io/projected/5786bddc-3e31-4279-ac8e-bde368ed7f6b-kube-api-access-z8ssc\") pod \"servicemesh-operator3-57f65f65fb-sgqgc\" (UID: \"5786bddc-3e31-4279-ac8e-bde368ed7f6b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.472000 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.471916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:28.626237 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.626214 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc"] Jun 11 14:25:28.628491 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:28.628461 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5786bddc_3e31_4279_ac8e_bde368ed7f6b.slice/crio-98625e4fe493a1478bb8590408e2ea9e7c7d27f409a018f35522e19337457b0c WatchSource:0}: Error finding container 98625e4fe493a1478bb8590408e2ea9e7c7d27f409a018f35522e19337457b0c: Status 404 returned error can't find the container with id 98625e4fe493a1478bb8590408e2ea9e7c7d27f409a018f35522e19337457b0c Jun 11 14:25:28.652974 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:28.652949 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" event={"ID":"5786bddc-3e31-4279-ac8e-bde368ed7f6b","Type":"ContainerStarted","Data":"98625e4fe493a1478bb8590408e2ea9e7c7d27f409a018f35522e19337457b0c"} Jun 11 14:25:30.251436 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:30.251394 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:30.365648 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:30.365610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:31.670573 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:31.670534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" event={"ID":"5786bddc-3e31-4279-ac8e-bde368ed7f6b","Type":"ContainerStarted","Data":"0017bff85aac340d5761f21a9766acb085236ced5265c9890a4d1e231427e0eb"} Jun 11 14:25:31.671000 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:31.670692 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:31.692354 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:31.692309 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" podStartSLOduration=1.184643066 podStartE2EDuration="3.69229484s" totalImagesPullingTime="2.507651774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:31.690866259 +0000 UTC m=+493.251520648" watchObservedRunningTime="2026-06-11 14:25:31.69229484 +0000 UTC m=+493.252949228" Jun 11 14:25:35.044241 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:35.044190 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:35.107879 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:35.107843 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:37.199343 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:37.199290 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:37.302572 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:37.302535 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:40.890275 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.890239 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-k4bmv"] Jun 11 14:25:40.899739 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.899707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:40.901981 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.901955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-k4bmv"] Jun 11 14:25:40.903092 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.903070 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jwzvc\"" Jun 11 14:25:40.903203 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.903124 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 14:25:40.924294 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:40.924259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:41.000880 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.000846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85dd3545-815a-46db-9405-1addb210362f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.001073 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.000907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqkpg\" (UniqueName: \"kubernetes.io/projected/85dd3545-815a-46db-9405-1addb210362f-kube-api-access-cqkpg\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.102350 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.102313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqkpg\" (UniqueName: \"kubernetes.io/projected/85dd3545-815a-46db-9405-1addb210362f-kube-api-access-cqkpg\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.102541 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.102382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85dd3545-815a-46db-9405-1addb210362f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.103081 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.103034 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/85dd3545-815a-46db-9405-1addb210362f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.110276 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.110248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqkpg\" (UniqueName: \"kubernetes.io/projected/85dd3545-815a-46db-9405-1addb210362f-kube-api-access-cqkpg\") pod \"dashboard-redirect-56997bdbdf-k4bmv\" (UID: \"85dd3545-815a-46db-9405-1addb210362f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.211338 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.211245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" Jun 11 14:25:41.213177 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.213150 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5"] Jun 11 14:25:41.216281 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.216257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.218651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218448 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 14:25:41.218651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218495 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 14:25:41.218651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218544 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-84sg6\"" Jun 11 14:25:41.218651 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218495 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 14:25:41.218921 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218709 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:41.218921 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.218717 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 14:25:41.229203 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.229177 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5"] Jun 11 14:25:41.304548 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304701 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304701 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304701 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304865 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqgk\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-kube-api-access-szqgk\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304865 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.304865 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.304772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.316107 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.316030 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:41.349631 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.349598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-k4bmv"] Jun 11 14:25:41.353226 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:41.353198 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85dd3545_815a_46db_9405_1addb210362f.slice/crio-25e28f3b53d877740828bc6c038e4ad8a59b0333796a627fb70d02e3b0e2959a WatchSource:0}: Error finding container 25e28f3b53d877740828bc6c038e4ad8a59b0333796a627fb70d02e3b0e2959a: Status 404 returned error can't find the container with id 25e28f3b53d877740828bc6c038e4ad8a59b0333796a627fb70d02e3b0e2959a Jun 11 14:25:41.406201 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqgk\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-kube-api-access-szqgk\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406201 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.406447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.406385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.407055 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.407017 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.408835 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.408806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.408943 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.408908 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.409222 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.409200 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.409378 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.409342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.414216 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.414189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.414298 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.414275 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqgk\" (UniqueName: \"kubernetes.io/projected/71ce5fb2-fb46-433c-a233-12fcb1b5eb25-kube-api-access-szqgk\") pod \"istiod-openshift-gateway-75c67f8887-7drv5\" (UID: \"71ce5fb2-fb46-433c-a233-12fcb1b5eb25\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.541181 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.541085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:41.684186 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.683305 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5"] Jun 11 14:25:41.688115 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:25:41.688087 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ce5fb2_fb46_433c_a233_12fcb1b5eb25.slice/crio-d160aac6d5cf324e10fe9c459b55a96217276beef9bc1c2e250ed9280f6a90d3 WatchSource:0}: Error finding container d160aac6d5cf324e10fe9c459b55a96217276beef9bc1c2e250ed9280f6a90d3: Status 404 returned error can't find the container with id d160aac6d5cf324e10fe9c459b55a96217276beef9bc1c2e250ed9280f6a90d3 Jun 11 14:25:41.712709 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.712680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" event={"ID":"71ce5fb2-fb46-433c-a233-12fcb1b5eb25","Type":"ContainerStarted","Data":"d160aac6d5cf324e10fe9c459b55a96217276beef9bc1c2e250ed9280f6a90d3"} Jun 11 14:25:41.713754 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.713732 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" event={"ID":"85dd3545-815a-46db-9405-1addb210362f","Type":"ContainerStarted","Data":"25e28f3b53d877740828bc6c038e4ad8a59b0333796a627fb70d02e3b0e2959a"} Jun 11 14:25:41.796367 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:41.796326 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:42.676602 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:42.676564 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-sgqgc" Jun 11 14:25:47.572829 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:47.572787 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 14:25:47.573225 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:47.572858 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 14:25:47.751715 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:47.751681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" event={"ID":"71ce5fb2-fb46-433c-a233-12fcb1b5eb25","Type":"ContainerStarted","Data":"8818b2bee40784cf05ffc24ddf9e02e3453d4bcf2b77c7f9db86177d59f0b42b"} Jun 11 14:25:47.751904 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:47.751806 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:47.771892 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:47.771842 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" podStartSLOduration=0.889458293 podStartE2EDuration="6.77182839s" totalImagesPullingTime="5.882370097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:47.770552298 +0000 UTC m=+509.331206687" watchObservedRunningTime="2026-06-11 14:25:47.77182839 +0000 UTC m=+509.332482757" Jun 11 14:25:48.287265 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.287170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:48.387103 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.387063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:48.603822 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.603784 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:48.758777 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.758727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" event={"ID":"85dd3545-815a-46db-9405-1addb210362f","Type":"ContainerStarted","Data":"4482ad08a10ac7aaf1e145e28afcffc20736a3bc4b483391cc986659c7e56fe3"} Jun 11 14:25:48.761049 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.761012 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7drv5" Jun 11 14:25:48.773947 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.773899 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56997bdbdf-k4bmv" podStartSLOduration=2.101979853 podStartE2EDuration="8.773884533s" totalImagesPullingTime="6.67190468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:48.773027289 +0000 UTC m=+510.333681688" watchObservedRunningTime="2026-06-11 14:25:48.773884533 +0000 UTC m=+510.334538922" Jun 11 14:25:48.875692 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.875612 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:48.976956 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:48.976919 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:49.073195 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:49.073148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:54.274257 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:54.274217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:54.375025 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:54.374987 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:25:56.645842 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:56.645809 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6r5t4" Jun 11 14:25:56.648986 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:25:56.648967 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z872g" Jun 11 14:26:03.048755 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:03.048717 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:04.675675 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:04.675639 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:09.652854 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:09.652775 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:09.714283 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:09.714246 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:10.487344 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:10.487305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:10.584057 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:10.584013 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:10.692660 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:10.692626 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:11.725974 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:11.725942 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:11.815689 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:11.815658 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:31.316079 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:31.316012 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:31.397491 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:31.397457 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:33.762136 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:33.762105 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:34.165771 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:34.165739 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:35.217816 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:35.217776 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:35.372132 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:35.372102 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:38.189664 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:38.189626 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:38.512265 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:38.512173 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:41.889205 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:41.889167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:41.995218 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:41.995162 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:42.089441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:42.089404 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:42.187468 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:42.187376 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:42.713538 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:42.713501 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:44.186720 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:44.186670 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:44.914272 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:44.914236 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:45.905450 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.905418 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99"] Jun 11 14:26:45.908460 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.908443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:45.910806 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.910784 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:26:45.911617 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.911598 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 14:26:45.911724 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.911625 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:26:45.911724 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.911625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gth8x\"" Jun 11 14:26:45.925399 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.925378 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99"] Jun 11 14:26:45.953582 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:45.953550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtxf\" (UniqueName: \"kubernetes.io/projected/fa6ab70e-5126-47a6-a800-91810a922468-kube-api-access-qjtxf\") pod \"dns-operator-controller-manager-864dd78c4c-czt99\" (UID: \"fa6ab70e-5126-47a6-a800-91810a922468\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:46.054128 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:46.054088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtxf\" (UniqueName: \"kubernetes.io/projected/fa6ab70e-5126-47a6-a800-91810a922468-kube-api-access-qjtxf\") pod \"dns-operator-controller-manager-864dd78c4c-czt99\" (UID: \"fa6ab70e-5126-47a6-a800-91810a922468\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:46.062502 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:46.062474 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtxf\" (UniqueName: \"kubernetes.io/projected/fa6ab70e-5126-47a6-a800-91810a922468-kube-api-access-qjtxf\") pod \"dns-operator-controller-manager-864dd78c4c-czt99\" (UID: \"fa6ab70e-5126-47a6-a800-91810a922468\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:46.225230 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:46.225144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:46.360092 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:46.360060 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99"] Jun 11 14:26:46.363086 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:26:46.363057 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6ab70e_5126_47a6_a800_91810a922468.slice/crio-ac0cbe82a5f1bb6990d203b2752336c14d150923e2ea1b6b74071b29f22f838b WatchSource:0}: Error finding container ac0cbe82a5f1bb6990d203b2752336c14d150923e2ea1b6b74071b29f22f838b: Status 404 returned error can't find the container with id ac0cbe82a5f1bb6990d203b2752336c14d150923e2ea1b6b74071b29f22f838b Jun 11 14:26:47.013822 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:47.013738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" event={"ID":"fa6ab70e-5126-47a6-a800-91810a922468","Type":"ContainerStarted","Data":"ac0cbe82a5f1bb6990d203b2752336c14d150923e2ea1b6b74071b29f22f838b"} Jun 11 14:26:47.209784 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:47.209743 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:47.279414 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:47.279327 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:47.592066 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:47.592004 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:47.688378 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:47.688338 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:49.025285 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:49.025248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" event={"ID":"fa6ab70e-5126-47a6-a800-91810a922468","Type":"ContainerStarted","Data":"5509fdbedb4f89e91eadd6cf90bb606022e0e4d1e7803f792ae1255934f82d43"} Jun 11 14:26:49.025655 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:49.025342 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:26:49.044827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:49.044767 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" podStartSLOduration=1.937205885 podStartE2EDuration="4.044745187s" totalImagesPullingTime="2.107539302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:49.043950007 +0000 UTC m=+570.604604395" watchObservedRunningTime="2026-06-11 14:26:49.044745187 +0000 UTC m=+570.605399577" Jun 11 14:26:51.578110 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:51.578064 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:51.677891 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:51.677857 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:52.706129 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:52.706087 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:53.229730 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:53.229693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:26:59.794994 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:26:59.794955 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:00.032447 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:00.032412 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-czt99" Jun 11 14:27:01.115171 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:01.115140 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:02.438829 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:02.438792 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:02.565611 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:02.565569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:05.012691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:05.012651 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:07.038182 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:07.038148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:07.153434 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:07.153402 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:07.245033 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:07.244998 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:11.838216 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:11.838185 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:12.030793 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:12.030753 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:16.486980 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:16.486942 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:16.588469 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:16.588433 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:18.800102 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:18.800069 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:18.902805 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:18.902773 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:18.942842 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:18.942816 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:27:18.943008 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:18.942816 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:27:21.296517 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:21.296485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:21.371967 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:21.371928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:31.816679 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:31.816638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:31.968719 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:31.968679 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:34.010073 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.010004 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:34.014740 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.014712 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:34.017087 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.017061 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.019243 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.019224 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7wgp6\"" Jun 11 14:27:34.019370 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.019346 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 14:27:34.023829 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.023805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:34.069424 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.069392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsww\" (UniqueName: \"kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.069626 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.069489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.112163 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.112129 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:34.114828 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.114794 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:34.169713 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.169679 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:34.169982 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.169889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.169982 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.169968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsww\" (UniqueName: \"kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.170523 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.170504 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.177637 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.177611 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsww\" (UniqueName: \"kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww\") pod \"limitador-limitador-64c94fd64f-zpz7b\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.328124 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.328090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:34.459298 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.459272 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:34.465098 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:27:34.465003 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d116dbf_b998_4f7f_8844_5d0cecdb211f.slice/crio-e23ffe9ad015384d8831032c980774fe69501e388ef4b80770465b911fde345d WatchSource:0}: Error finding container e23ffe9ad015384d8831032c980774fe69501e388ef4b80770465b911fde345d: Status 404 returned error can't find the container with id e23ffe9ad015384d8831032c980774fe69501e388ef4b80770465b911fde345d Jun 11 14:27:34.873567 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.873517 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:34.985550 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:34.985520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:35.241443 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:35.241356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" event={"ID":"0d116dbf-b998-4f7f-8844-5d0cecdb211f","Type":"ContainerStarted","Data":"e23ffe9ad015384d8831032c980774fe69501e388ef4b80770465b911fde345d"} Jun 11 14:27:38.257703 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:38.257670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" event={"ID":"0d116dbf-b998-4f7f-8844-5d0cecdb211f","Type":"ContainerStarted","Data":"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8"} Jun 11 14:27:38.258103 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:38.257792 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:38.274711 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:38.274656 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" podStartSLOduration=2.4816708 podStartE2EDuration="5.274641256s" totalImagesPullingTime="2.792970456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:38.273395481 +0000 UTC m=+619.834049870" watchObservedRunningTime="2026-06-11 14:27:38.274641256 +0000 UTC m=+619.835295646" Jun 11 14:27:49.264641 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:49.264608 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:50.646224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:50.646188 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:50.646752 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:50.646365 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" podUID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" containerName="limitador" containerID="cri-o://621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8" gracePeriod=30 Jun 11 14:27:51.194108 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.194082 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:51.317033 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.317001 2580 generic.go:356] "Generic (PLEG): container finished" podID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" containerID="621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8" exitCode=0 Jun 11 14:27:51.317214 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.317060 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" Jun 11 14:27:51.317214 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.317090 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" event={"ID":"0d116dbf-b998-4f7f-8844-5d0cecdb211f","Type":"ContainerDied","Data":"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8"} Jun 11 14:27:51.317214 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.317155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpz7b" event={"ID":"0d116dbf-b998-4f7f-8844-5d0cecdb211f","Type":"ContainerDied","Data":"e23ffe9ad015384d8831032c980774fe69501e388ef4b80770465b911fde345d"} Jun 11 14:27:51.317214 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.317178 2580 scope.go:117] "RemoveContainer" containerID="621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8" Jun 11 14:27:51.324823 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.324797 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgsww\" (UniqueName: \"kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww\") pod \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " Jun 11 14:27:51.324954 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.324871 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file\") pod \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\" (UID: \"0d116dbf-b998-4f7f-8844-5d0cecdb211f\") " Jun 11 14:27:51.325302 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.325283 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file" (OuterVolumeSpecName: "config-file") pod "0d116dbf-b998-4f7f-8844-5d0cecdb211f" (UID: "0d116dbf-b998-4f7f-8844-5d0cecdb211f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:27:51.326341 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.326319 2580 scope.go:117] "RemoveContainer" containerID="621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8" Jun 11 14:27:51.326629 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:27:51.326608 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8\": container with ID starting with 621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8 not found: ID does not exist" containerID="621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8" Jun 11 14:27:51.326689 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.326637 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8"} err="failed to get container status \"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8\": rpc error: code = NotFound desc = could not find container \"621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8\": container with ID starting with 621f33716a8d2ebcd0ca1f1df60f8d741df42211b712a191eedc22c4975993f8 not found: ID does not exist" Jun 11 14:27:51.327018 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.326990 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww" (OuterVolumeSpecName: "kube-api-access-jgsww") pod "0d116dbf-b998-4f7f-8844-5d0cecdb211f" (UID: "0d116dbf-b998-4f7f-8844-5d0cecdb211f"). InnerVolumeSpecName "kube-api-access-jgsww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:27:51.425685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.425651 2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d116dbf-b998-4f7f-8844-5d0cecdb211f-config-file\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Jun 11 14:27:51.425685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.425680 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgsww\" (UniqueName: \"kubernetes.io/projected/0d116dbf-b998-4f7f-8844-5d0cecdb211f-kube-api-access-jgsww\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Jun 11 14:27:51.641685 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.641654 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:51.646800 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:51.646774 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpz7b"] Jun 11 14:27:52.958944 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:52.958905 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" path="/var/lib/kubelet/pods/0d116dbf-b998-4f7f-8844-5d0cecdb211f/volumes" Jun 11 14:27:55.280324 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.280289 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:55.377737 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.377707 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:55.759378 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.759347 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps"] Jun 11 14:27:55.759679 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.759667 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" containerName="limitador" Jun 11 14:27:55.759728 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.759680 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" containerName="limitador" Jun 11 14:27:55.759762 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.759734 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d116dbf-b998-4f7f-8844-5d0cecdb211f" containerName="limitador" Jun 11 14:27:55.762535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.762512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.765162 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.765137 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-p5c8g\"" Jun 11 14:27:55.765304 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.765284 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 11 14:27:55.766009 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.765991 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 11 14:27:55.766105 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.765995 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 11 14:27:55.777573 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.777547 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps"] Jun 11 14:27:55.835877 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.835845 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:27:55.864965 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.864932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg626\" (UniqueName: \"kubernetes.io/projected/485422c5-bbac-4005-af7d-dbf96e4cef61-kube-api-access-wg626\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.864965 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.864969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/485422c5-bbac-4005-af7d-dbf96e4cef61-data\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.966436 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.966402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/485422c5-bbac-4005-af7d-dbf96e4cef61-data\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.966599 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.966511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg626\" (UniqueName: \"kubernetes.io/projected/485422c5-bbac-4005-af7d-dbf96e4cef61-kube-api-access-wg626\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.966867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.966845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/485422c5-bbac-4005-af7d-dbf96e4cef61-data\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:55.975611 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:55.975580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg626\" (UniqueName: \"kubernetes.io/projected/485422c5-bbac-4005-af7d-dbf96e4cef61-kube-api-access-wg626\") pod \"postgres-69fb4594cf-jgfps\" (UID: \"485422c5-bbac-4005-af7d-dbf96e4cef61\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:56.073737 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:56.073699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:56.203691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:56.203667 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps"] Jun 11 14:27:56.206523 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:27:56.206493 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485422c5_bbac_4005_af7d_dbf96e4cef61.slice/crio-4ee3a5020aff41a7be566b655bcbf360f4cce100c54dba1b4e6215dd17913a7b WatchSource:0}: Error finding container 4ee3a5020aff41a7be566b655bcbf360f4cce100c54dba1b4e6215dd17913a7b: Status 404 returned error can't find the container with id 4ee3a5020aff41a7be566b655bcbf360f4cce100c54dba1b4e6215dd17913a7b Jun 11 14:27:56.341668 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:56.341587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" event={"ID":"485422c5-bbac-4005-af7d-dbf96e4cef61","Type":"ContainerStarted","Data":"4ee3a5020aff41a7be566b655bcbf360f4cce100c54dba1b4e6215dd17913a7b"} Jun 11 14:27:59.356471 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:59.356431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" event={"ID":"485422c5-bbac-4005-af7d-dbf96e4cef61","Type":"ContainerStarted","Data":"32c842b73d758fc65886d2d1c4e85257211dfdfa9b220cc2e4178b37eef02067"} Jun 11 14:27:59.356915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:59.356534 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:27:59.381289 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:27:59.381239 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" podStartSLOduration=1.61300182 podStartE2EDuration="4.381225328s" totalImagesPullingTime="2.768223508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:59.378166197 +0000 UTC m=+640.938820587" watchObservedRunningTime="2026-06-11 14:27:59.381225328 +0000 UTC m=+640.941879716" Jun 11 14:28:05.390742 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:05.390711 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jgfps" Jun 11 14:28:05.682170 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:05.682070 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:05.780731 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:05.780691 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:05.945388 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:05.945302 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:15.710448 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.710411 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-p9b7x"] Jun 11 14:28:15.717156 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.717132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" Jun 11 14:28:15.722589 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.722560 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.722589 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.722562 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.722811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.722563 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-86kr2\"" Jun 11 14:28:15.806562 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.806532 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-p9b7x"] Jun 11 14:28:15.826822 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.826784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdc5b\" (UniqueName: \"kubernetes.io/projected/0b76b408-c623-4604-be05-e7565687935e-kube-api-access-xdc5b\") pod \"keycloak-operator-d67dbbb48-p9b7x\" (UID: \"0b76b408-c623-4604-be05-e7565687935e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" Jun 11 14:28:15.928191 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.928153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdc5b\" (UniqueName: \"kubernetes.io/projected/0b76b408-c623-4604-be05-e7565687935e-kube-api-access-xdc5b\") pod \"keycloak-operator-d67dbbb48-p9b7x\" (UID: \"0b76b408-c623-4604-be05-e7565687935e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" Jun 11 14:28:15.940209 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:15.940178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdc5b\" (UniqueName: \"kubernetes.io/projected/0b76b408-c623-4604-be05-e7565687935e-kube-api-access-xdc5b\") pod \"keycloak-operator-d67dbbb48-p9b7x\" (UID: \"0b76b408-c623-4604-be05-e7565687935e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" Jun 11 14:28:16.027683 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:16.027609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" Jun 11 14:28:16.162882 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:16.162852 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-p9b7x"] Jun 11 14:28:16.166066 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:28:16.166015 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b76b408_c623_4604_be05_e7565687935e.slice/crio-43fa72f14e948a778363d27cc99fa0b8e44a71969ca10aed1b9e4b8cc377e6b7 WatchSource:0}: Error finding container 43fa72f14e948a778363d27cc99fa0b8e44a71969ca10aed1b9e4b8cc377e6b7: Status 404 returned error can't find the container with id 43fa72f14e948a778363d27cc99fa0b8e44a71969ca10aed1b9e4b8cc377e6b7 Jun 11 14:28:16.433767 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:16.433730 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" event={"ID":"0b76b408-c623-4604-be05-e7565687935e","Type":"ContainerStarted","Data":"43fa72f14e948a778363d27cc99fa0b8e44a71969ca10aed1b9e4b8cc377e6b7"} Jun 11 14:28:25.483998 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:25.483957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" event={"ID":"0b76b408-c623-4604-be05-e7565687935e","Type":"ContainerStarted","Data":"47df584d9ea60c58f505c4ed85b5b5ea3aab983aadb9e8d9770e5ebfa3cca998"} Jun 11 14:28:25.502379 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:25.502327 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-p9b7x" podStartSLOduration=2.181144407 podStartE2EDuration="10.502309997s" totalImagesPullingTime="8.32116559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:25.501404646 +0000 UTC m=+667.062059035" watchObservedRunningTime="2026-06-11 14:28:25.502309997 +0000 UTC m=+667.062964386" Jun 11 14:28:33.566516 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:33.566470 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:33.667312 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:28:33.667274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:01.109414 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:01.109377 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:01.168442 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:01.168405 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:04.066421 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:04.066382 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:04.450801 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:04.450712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:10.355080 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.354971 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:10.371194 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.371165 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:10.373309 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.373293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.376196 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.376171 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 14:29:10.376323 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.376282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 14:29:10.376464 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.376435 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bxmwr\"" Jun 11 14:29:10.390536 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.390508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:10.390846 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.390820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.390926 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.390912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npkkk\" (UniqueName: \"kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.454713 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.454681 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:10.492160 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.492127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.492311 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.492190 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npkkk\" (UniqueName: \"kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.492311 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:29:10.492285 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 14:29:10.492380 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:29:10.492363 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert podName:3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:10.992342706 +0000 UTC m=+712.552997078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert") pod "maas-controller-ffbb44b6c-x4v4d" (UID: "3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74") : secret "maas-controller-webhook-cert" not found Jun 11 14:29:10.500868 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.500842 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npkkk\" (UniqueName: \"kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.537774 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.537745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:10.647554 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.647468 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:10.996700 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.996618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:10.999014 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:10.998981 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") pod \"maas-controller-ffbb44b6c-x4v4d\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:11.284473 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:11.284380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:11.413276 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:11.413247 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:11.415932 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:29:11.415898 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8bcc6e_6b95_4dac_a6d4_61c37b7eff74.slice/crio-f2d6676426f642fe7ea2c20730e55d56e7cb0224b95cc8eb8e20de41143c4203 WatchSource:0}: Error finding container f2d6676426f642fe7ea2c20730e55d56e7cb0224b95cc8eb8e20de41143c4203: Status 404 returned error can't find the container with id f2d6676426f642fe7ea2c20730e55d56e7cb0224b95cc8eb8e20de41143c4203 Jun 11 14:29:11.702759 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:11.702723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" event={"ID":"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74","Type":"ContainerStarted","Data":"f2d6676426f642fe7ea2c20730e55d56e7cb0224b95cc8eb8e20de41143c4203"} Jun 11 14:29:13.738567 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:13.738530 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:13.839818 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:13.839778 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:14.724543 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:14.724486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" event={"ID":"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74","Type":"ContainerStarted","Data":"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02"} Jun 11 14:29:14.724741 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:14.724705 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:14.741522 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:14.741472 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" podStartSLOduration=2.103098347 podStartE2EDuration="4.741456822s" totalImagesPullingTime="2.638358475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:14.740532898 +0000 UTC m=+716.301187298" watchObservedRunningTime="2026-06-11 14:29:14.741456822 +0000 UTC m=+716.302111211" Jun 11 14:29:24.712494 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:24.712445 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:24.713059 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:24.712695 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" podUID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" containerName="manager" containerID="cri-o://1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02" gracePeriod=30 Jun 11 14:29:24.719219 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:24.719197 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:24.959284 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:24.959257 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:25.017247 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.017163 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npkkk\" (UniqueName: \"kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk\") pod \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " Jun 11 14:29:25.017247 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.017223 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") pod \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\" (UID: \"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74\") " Jun 11 14:29:25.019280 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.019247 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" (UID: "3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:29:25.019414 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.019374 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk" (OuterVolumeSpecName: "kube-api-access-npkkk") pod "3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" (UID: "3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74"). InnerVolumeSpecName "kube-api-access-npkkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:29:25.118884 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.118844 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npkkk\" (UniqueName: \"kubernetes.io/projected/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-kube-api-access-npkkk\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Jun 11 14:29:25.118884 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.118874 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74-webhook-cert\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Jun 11 14:29:25.774101 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.774070 2580 generic.go:356] "Generic (PLEG): container finished" podID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" containerID="1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02" exitCode=0 Jun 11 14:29:25.774487 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.774159 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" Jun 11 14:29:25.774487 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.774168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" event={"ID":"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74","Type":"ContainerDied","Data":"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02"} Jun 11 14:29:25.774487 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.774211 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffbb44b6c-x4v4d" event={"ID":"3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74","Type":"ContainerDied","Data":"f2d6676426f642fe7ea2c20730e55d56e7cb0224b95cc8eb8e20de41143c4203"} Jun 11 14:29:25.774487 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.774233 2580 scope.go:117] "RemoveContainer" containerID="1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02" Jun 11 14:29:25.787766 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.787747 2580 scope.go:117] "RemoveContainer" containerID="1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02" Jun 11 14:29:25.788066 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:29:25.788031 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02\": container with ID starting with 1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02 not found: ID does not exist" containerID="1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02" Jun 11 14:29:25.788113 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.788075 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02"} err="failed to get container status \"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02\": rpc error: code = NotFound desc = could not find container \"1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02\": container with ID starting with 1dbf9bedd299aafa039d3288942d76798b516458612e1c1b735beefc2cbadb02 not found: ID does not exist" Jun 11 14:29:25.799838 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.799808 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:25.807076 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:25.807017 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ffbb44b6c-x4v4d"] Jun 11 14:29:26.959139 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:26.959098 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" path="/var/lib/kubelet/pods/3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74/volumes" Jun 11 14:29:44.805163 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:44.805115 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:45.185575 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.185485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:45.284512 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.284466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:45.325776 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.325736 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hslg9"] Jun 11 14:29:45.326298 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.326270 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" containerName="manager" Jun 11 14:29:45.326477 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.326463 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" containerName="manager" Jun 11 14:29:45.326691 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.326674 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8bcc6e-6b95-4dac-a6d4-61c37b7eff74" containerName="manager" Jun 11 14:29:45.329695 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.329675 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:45.332096 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.332074 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 14:29:45.332208 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.332075 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2nftj\"" Jun 11 14:29:45.340912 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.340889 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hslg9"] Jun 11 14:29:45.360135 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.360102 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:45.493335 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.493240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ff7\" (UniqueName: \"kubernetes.io/projected/66a97514-a3be-4ccc-b564-e3ac6b5820b7-kube-api-access-t6ff7\") pod \"payload-pre-processing-579785bc64-hslg9\" (UID: \"66a97514-a3be-4ccc-b564-e3ac6b5820b7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:45.594117 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.594073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ff7\" (UniqueName: \"kubernetes.io/projected/66a97514-a3be-4ccc-b564-e3ac6b5820b7-kube-api-access-t6ff7\") pod \"payload-pre-processing-579785bc64-hslg9\" (UID: \"66a97514-a3be-4ccc-b564-e3ac6b5820b7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:45.602166 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.602130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ff7\" (UniqueName: \"kubernetes.io/projected/66a97514-a3be-4ccc-b564-e3ac6b5820b7-kube-api-access-t6ff7\") pod \"payload-pre-processing-579785bc64-hslg9\" (UID: \"66a97514-a3be-4ccc-b564-e3ac6b5820b7\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:45.640142 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.640104 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:45.768663 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.768610 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hslg9"] Jun 11 14:29:45.771140 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:29:45.771114 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a97514_a3be_4ccc_b564_e3ac6b5820b7.slice/crio-75cd9c87257be28045a3b9d3563ef71771e50491ae80df0dd4f8cb0996fc2b2e WatchSource:0}: Error finding container 75cd9c87257be28045a3b9d3563ef71771e50491ae80df0dd4f8cb0996fc2b2e: Status 404 returned error can't find the container with id 75cd9c87257be28045a3b9d3563ef71771e50491ae80df0dd4f8cb0996fc2b2e Jun 11 14:29:45.773623 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.773605 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:29:45.867632 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:45.867599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" event={"ID":"66a97514-a3be-4ccc-b564-e3ac6b5820b7","Type":"ContainerStarted","Data":"75cd9c87257be28045a3b9d3563ef71771e50491ae80df0dd4f8cb0996fc2b2e"} Jun 11 14:29:48.886442 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:48.886399 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" event={"ID":"66a97514-a3be-4ccc-b564-e3ac6b5820b7","Type":"ContainerStarted","Data":"584e2ea9f6ba3f546f1876a984318dfd9ff5ab5d05f43e8ed7fee1a7bef76dde"} Jun 11 14:29:48.886866 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:48.886459 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:29:48.902107 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:48.902034 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" podStartSLOduration=1.700287705 podStartE2EDuration="3.902019114s" totalImagesPullingTime="2.201731409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:48.901172625 +0000 UTC m=+750.461827014" watchObservedRunningTime="2026-06-11 14:29:48.902019114 +0000 UTC m=+750.462673506" Jun 11 14:29:59.892702 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:29:59.892670 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hslg9" Jun 11 14:30:00.133246 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.133212 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:30:00.135527 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.135508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:30:00.137644 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.137625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-rq452\"" Jun 11 14:30:00.141704 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.141675 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:30:00.217435 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.217388 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxs5p\" (UniqueName: \"kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p\") pod \"maas-api-key-cleanup-29686470-28v58\" (UID: \"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:30:00.317810 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.317773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxs5p\" (UniqueName: \"kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p\") pod \"maas-api-key-cleanup-29686470-28v58\" (UID: \"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:30:00.325601 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.325573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxs5p\" (UniqueName: \"kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p\") pod \"maas-api-key-cleanup-29686470-28v58\" (UID: \"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:30:00.448639 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.448551 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:30:00.578640 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.578608 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:30:00.582771 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:30:00.582740 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e8a50e_bc0e_4f18_ae3b_ce6c5aecc02f.slice/crio-71c99be4cdb36a826d4a9b76f82386dcc02f8a81709b6690d1d686f0070f99d0 WatchSource:0}: Error finding container 71c99be4cdb36a826d4a9b76f82386dcc02f8a81709b6690d1d686f0070f99d0: Status 404 returned error can't find the container with id 71c99be4cdb36a826d4a9b76f82386dcc02f8a81709b6690d1d686f0070f99d0 Jun 11 14:30:00.941535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:00.941498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" event={"ID":"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f","Type":"ContainerStarted","Data":"71c99be4cdb36a826d4a9b76f82386dcc02f8a81709b6690d1d686f0070f99d0"} Jun 11 14:30:03.958635 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:03.958590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" event={"ID":"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f","Type":"ContainerStarted","Data":"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f"} Jun 11 14:30:03.975190 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:30:03.975145 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" podStartSLOduration=1.3791196989999999 podStartE2EDuration="3.97512956s" totalImagesPullingTime="2.596009861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:30:03.97339396 +0000 UTC m=+765.534048348" watchObservedRunningTime="2026-06-11 14:30:03.97512956 +0000 UTC m=+765.535783949" Jun 11 14:31:00.011148 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:00.011113 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:31:00.011677 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:00.011336 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" podUID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" containerName="cleanup" containerID="cri-o://238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f" gracePeriod=30 Jun 11 14:31:16.560016 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:16.559977 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:30.187645 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.187620 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:31:30.261805 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.261770 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxs5p\" (UniqueName: \"kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p\") pod \"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f\" (UID: \"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f\") " Jun 11 14:31:30.263908 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.263886 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p" (OuterVolumeSpecName: "kube-api-access-zxs5p") pod "88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" (UID: "88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f"). InnerVolumeSpecName "kube-api-access-zxs5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:31:30.358629 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.358593 2580 generic.go:356] "Generic (PLEG): container finished" podID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" containerID="238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f" exitCode=137 Jun 11 14:31:30.358820 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.358646 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" Jun 11 14:31:30.358820 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.358668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" event={"ID":"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f","Type":"ContainerDied","Data":"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f"} Jun 11 14:31:30.358820 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.358740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58" event={"ID":"88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f","Type":"ContainerDied","Data":"71c99be4cdb36a826d4a9b76f82386dcc02f8a81709b6690d1d686f0070f99d0"} Jun 11 14:31:30.358820 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.358762 2580 scope.go:117] "RemoveContainer" containerID="238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f" Jun 11 14:31:30.362472 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.362450 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxs5p\" (UniqueName: \"kubernetes.io/projected/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f-kube-api-access-zxs5p\") on node \"ip-10-0-137-224.ec2.internal\" DevicePath \"\"" Jun 11 14:31:30.367477 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.367459 2580 scope.go:117] "RemoveContainer" containerID="238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f" Jun 11 14:31:30.367751 ip-10-0-137-224 kubenswrapper[2580]: E0611 14:31:30.367732 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f\": container with ID starting with 238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f not found: ID does not exist" containerID="238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f" Jun 11 14:31:30.367808 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.367765 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f"} err="failed to get container status \"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f\": rpc error: code = NotFound desc = could not find container \"238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f\": container with ID starting with 238ea3d08e50f7fc0c18df470d6a32fd3107972ebcd04eae382996ab623e166f not found: ID does not exist" Jun 11 14:31:30.380130 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.380109 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:31:30.385416 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.385394 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29686470-28v58"] Jun 11 14:31:30.959421 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:30.959388 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" path="/var/lib/kubelet/pods/88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f/volumes" Jun 11 14:31:48.225579 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:31:48.225544 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:18.969199 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:32:18.969130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:32:18.971862 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:32:18.971830 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cg9v5_8f81b9a0-1c04-4221-9cab-437f0066c3a3/ovn-acl-logging/0.log" Jun 11 14:32:48.640736 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:32:48.640697 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:49.729560 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:32:49.729526 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:58.436011 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:32:58.435978 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:05.692523 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.692485 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27"] Jun 11 14:33:05.693072 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.693054 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" containerName="cleanup" Jun 11 14:33:05.693146 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.693074 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" containerName="cleanup" Jun 11 14:33:05.693183 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.693164 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e8a50e-bc0e-4f18-ae3b-ce6c5aecc02f" containerName="cleanup" Jun 11 14:33:05.696664 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.696644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.702132 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.702110 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 14:33:05.702254 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.702116 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 14:33:05.702254 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.702131 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zl5mj\"" Jun 11 14:33:05.702640 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.702625 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 14:33:05.720351 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.720463 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.720463 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.720535 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.720569 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720549 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pl8f\" (UniqueName: \"kubernetes.io/projected/b2b4951f-593c-4eb2-8ea2-d538812088f3-kube-api-access-9pl8f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.720612 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.720582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b4951f-593c-4eb2-8ea2-d538812088f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.723944 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.723918 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27"] Jun 11 14:33:05.783603 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.783559 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:05.821817 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.821817 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pl8f\" (UniqueName: \"kubernetes.io/projected/b2b4951f-593c-4eb2-8ea2-d538812088f3-kube-api-access-9pl8f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b4951f-593c-4eb2-8ea2-d538812088f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822088 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.821905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822328 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.822300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822387 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.822324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.822387 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.822365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.824242 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.824220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b4951f-593c-4eb2-8ea2-d538812088f3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.824497 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.824480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b4951f-593c-4eb2-8ea2-d538812088f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:05.832841 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:05.832817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pl8f\" (UniqueName: \"kubernetes.io/projected/b2b4951f-593c-4eb2-8ea2-d538812088f3-kube-api-access-9pl8f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-xrc27\" (UID: \"b2b4951f-593c-4eb2-8ea2-d538812088f3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:06.007388 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:06.007292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:06.177349 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:06.177314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27"] Jun 11 14:33:06.183272 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:33:06.183244 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b4951f_593c_4eb2_8ea2_d538812088f3.slice/crio-a30b84bd5d23587319b91d42c595e6d7f7b8ced4cb30fbc61c9df5fa21109188 WatchSource:0}: Error finding container a30b84bd5d23587319b91d42c595e6d7f7b8ced4cb30fbc61c9df5fa21109188: Status 404 returned error can't find the container with id a30b84bd5d23587319b91d42c595e6d7f7b8ced4cb30fbc61c9df5fa21109188 Jun 11 14:33:06.249352 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:06.249317 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:06.357421 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:06.357379 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:06.818702 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:06.818660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" event={"ID":"b2b4951f-593c-4eb2-8ea2-d538812088f3","Type":"ContainerStarted","Data":"a30b84bd5d23587319b91d42c595e6d7f7b8ced4cb30fbc61c9df5fa21109188"} Jun 11 14:33:09.837536 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:09.837500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" event={"ID":"b2b4951f-593c-4eb2-8ea2-d538812088f3","Type":"ContainerStarted","Data":"9913c138f130d6b7b322526f6fe0e7e2993023bd270771fd782338a4b8ae0bf7"} Jun 11 14:33:12.856871 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:12.856835 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2b4951f-593c-4eb2-8ea2-d538812088f3" containerID="9913c138f130d6b7b322526f6fe0e7e2993023bd270771fd782338a4b8ae0bf7" exitCode=0 Jun 11 14:33:12.857395 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:12.856914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" event={"ID":"b2b4951f-593c-4eb2-8ea2-d538812088f3","Type":"ContainerDied","Data":"9913c138f130d6b7b322526f6fe0e7e2993023bd270771fd782338a4b8ae0bf7"} Jun 11 14:33:13.786720 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:13.786679 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:14.869855 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:14.869817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" event={"ID":"b2b4951f-593c-4eb2-8ea2-d538812088f3","Type":"ContainerStarted","Data":"276a8614477c33f204ec0373c7a88b2d1d78d942314f179cdaa610ce678fefc1"} Jun 11 14:33:14.890748 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:14.890700 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" podStartSLOduration=3.002203055 podStartE2EDuration="9.890685054s" totalImagesPullingTime="4.230584804s" totalInitContainerRuntime="2.657897195s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:33:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:33:14.888657839 +0000 UTC m=+956.449312228" watchObservedRunningTime="2026-06-11 14:33:14.890685054 +0000 UTC m=+956.451339484" Jun 11 14:33:16.008388 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:16.008352 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:16.008850 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:16.008658 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:16.021026 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:16.020998 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:16.890232 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:16.890203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-xrc27" Jun 11 14:33:17.885780 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:17.885735 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:33.186892 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.186856 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56"] Jun 11 14:33:33.200349 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.200323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.204079 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.204052 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 14:33:33.214555 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.214533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56"] Jun 11 14:33:33.237083 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.237018 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:33.269718 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.269718 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83346c5b-fd7e-4842-bbc7-fd93022e1d00-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.269917 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.269917 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5cg\" (UniqueName: \"kubernetes.io/projected/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kube-api-access-qw5cg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.269917 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.269917 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.269880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.370798 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.370798 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83346c5b-fd7e-4842-bbc7-fd93022e1d00-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371123 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371123 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5cg\" (UniqueName: \"kubernetes.io/projected/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kube-api-access-qw5cg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371123 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371123 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.370991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371455 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.371429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371455 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.371442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.371619 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.371496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.373348 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.373328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83346c5b-fd7e-4842-bbc7-fd93022e1d00-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.373503 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.373488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83346c5b-fd7e-4842-bbc7-fd93022e1d00-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.379974 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.379953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5cg\" (UniqueName: \"kubernetes.io/projected/83346c5b-fd7e-4842-bbc7-fd93022e1d00-kube-api-access-qw5cg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-kmg56\" (UID: \"83346c5b-fd7e-4842-bbc7-fd93022e1d00\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.510818 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.510739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:33:33.642415 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.642389 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56"] Jun 11 14:33:33.645031 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:33:33.644997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83346c5b_fd7e_4842_bbc7_fd93022e1d00.slice/crio-627ba1168c1b8f0602a05a8b80523a46b7081dba4deb1217ca5380ca3d6b0adb WatchSource:0}: Error finding container 627ba1168c1b8f0602a05a8b80523a46b7081dba4deb1217ca5380ca3d6b0adb: Status 404 returned error can't find the container with id 627ba1168c1b8f0602a05a8b80523a46b7081dba4deb1217ca5380ca3d6b0adb Jun 11 14:33:33.960409 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.960372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" event={"ID":"83346c5b-fd7e-4842-bbc7-fd93022e1d00","Type":"ContainerStarted","Data":"92c1c01edd03e851bfce701d6927fa37facab590f0dbca44c6754ba90f7cc5c4"} Jun 11 14:33:33.960583 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:33.960432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" event={"ID":"83346c5b-fd7e-4842-bbc7-fd93022e1d00","Type":"ContainerStarted","Data":"627ba1168c1b8f0602a05a8b80523a46b7081dba4deb1217ca5380ca3d6b0adb"} Jun 11 14:33:37.750208 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.750173 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5"] Jun 11 14:33:37.753913 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.753887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.756491 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.756469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 14:33:37.768472 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.768444 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5"] Jun 11 14:33:37.802698 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.802662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:37.912406 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.912591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.912591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fc10f4-e949-4093-acba-ad4525966a57-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.912591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7pbh\" (UniqueName: \"kubernetes.io/projected/82fc10f4-e949-4093-acba-ad4525966a57-kube-api-access-n7pbh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.912591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:37.912591 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:37.912584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fc10f4-e949-4093-acba-ad4525966a57-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013441 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7pbh\" (UniqueName: \"kubernetes.io/projected/82fc10f4-e949-4093-acba-ad4525966a57-kube-api-access-n7pbh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013767 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013767 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013870 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.013951 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.013911 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.015785 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.015759 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82fc10f4-e949-4093-acba-ad4525966a57-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.016097 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.016078 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fc10f4-e949-4093-acba-ad4525966a57-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.022206 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.022183 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7pbh\" (UniqueName: \"kubernetes.io/projected/82fc10f4-e949-4093-acba-ad4525966a57-kube-api-access-n7pbh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-kkgx5\" (UID: \"82fc10f4-e949-4093-acba-ad4525966a57\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.065167 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.065118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:38.212404 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.212333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5"] Jun 11 14:33:38.216454 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:33:38.216426 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fc10f4_e949_4093_acba_ad4525966a57.slice/crio-0315f0798644a9d41b212e5f938a00e43a4cdab05fc4131c6213e0fab85ccd58 WatchSource:0}: Error finding container 0315f0798644a9d41b212e5f938a00e43a4cdab05fc4131c6213e0fab85ccd58: Status 404 returned error can't find the container with id 0315f0798644a9d41b212e5f938a00e43a4cdab05fc4131c6213e0fab85ccd58 Jun 11 14:33:38.985290 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.985245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" event={"ID":"82fc10f4-e949-4093-acba-ad4525966a57","Type":"ContainerStarted","Data":"5a34a395c7a7b547e8c1c4608f598f9ac5acccba14b6f84d807f8a1ea86cb8bd"} Jun 11 14:33:38.985290 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:38.985293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" event={"ID":"82fc10f4-e949-4093-acba-ad4525966a57","Type":"ContainerStarted","Data":"0315f0798644a9d41b212e5f938a00e43a4cdab05fc4131c6213e0fab85ccd58"} Jun 11 14:33:42.002084 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:42.002033 2580 generic.go:356] "Generic (PLEG): container finished" podID="82fc10f4-e949-4093-acba-ad4525966a57" containerID="5a34a395c7a7b547e8c1c4608f598f9ac5acccba14b6f84d807f8a1ea86cb8bd" exitCode=0 Jun 11 14:33:42.002505 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:42.002112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" event={"ID":"82fc10f4-e949-4093-acba-ad4525966a57","Type":"ContainerDied","Data":"5a34a395c7a7b547e8c1c4608f598f9ac5acccba14b6f84d807f8a1ea86cb8bd"} Jun 11 14:33:43.008232 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:43.008197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" event={"ID":"82fc10f4-e949-4093-acba-ad4525966a57","Type":"ContainerStarted","Data":"5679a316643fea21a187b5425c10f00541e15127a058806a1694723c5dbb5df9"} Jun 11 14:33:43.028379 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:43.028325 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" podStartSLOduration=2.406578892 podStartE2EDuration="6.028309042s" totalImagesPullingTime="429.602521ms" totalInitContainerRuntime="3.192127629s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:33:43.026711103 +0000 UTC m=+984.587365495" watchObservedRunningTime="2026-06-11 14:33:43.028309042 +0000 UTC m=+984.588963460" Jun 11 14:33:48.065822 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:48.065775 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:48.066305 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:48.065875 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:48.078055 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:48.078011 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:33:49.047546 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:33:49.047520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-kkgx5" Jun 11 14:34:28.234104 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:28.234066 2580 generic.go:356] "Generic (PLEG): container finished" podID="83346c5b-fd7e-4842-bbc7-fd93022e1d00" containerID="92c1c01edd03e851bfce701d6927fa37facab590f0dbca44c6754ba90f7cc5c4" exitCode=0 Jun 11 14:34:28.234670 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:28.234071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" event={"ID":"83346c5b-fd7e-4842-bbc7-fd93022e1d00","Type":"ContainerDied","Data":"92c1c01edd03e851bfce701d6927fa37facab590f0dbca44c6754ba90f7cc5c4"} Jun 11 14:34:29.241915 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:29.241876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" event={"ID":"83346c5b-fd7e-4842-bbc7-fd93022e1d00","Type":"ContainerStarted","Data":"70e8f3ecbbb91aa479dd7ef7228a56a878638e56cb332ee4a602dba83edf2386"} Jun 11 14:34:29.260549 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:29.260490 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" podStartSLOduration=2.061122267 podStartE2EDuration="56.260451349s" totalImagesPullingTime="380.864418ms" totalInitContainerRuntime="53.818464664s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:34:29.260130091 +0000 UTC m=+1030.820784481" watchObservedRunningTime="2026-06-11 14:34:29.260451349 +0000 UTC m=+1030.821105738" Jun 11 14:34:33.511462 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:33.511407 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:34:33.511858 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:33.511495 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:34:33.523923 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:33.523898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:34:34.277504 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:34.277475 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-kmg56" Jun 11 14:34:48.248224 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:48.248181 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:48.389569 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:48.389536 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:49.229413 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:49.229382 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:49.419141 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:49.419107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:49.535339 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:34:49.535263 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:16.191886 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:16.191807 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:18.194598 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:18.194566 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:32.587906 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:32.587872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56997bdbdf-k4bmv_85dd3545-815a-46db-9405-1addb210362f/nginx/0.log" Jun 11 14:35:32.723590 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:32.723540 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z872g_a45fb5ff-495b-4109-9828-c48e2c960d3f/manager/0.log" Jun 11 14:35:32.849781 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:32.849702 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6r5t4_441bbe20-ff15-4de9-9fac-58ff48fb2e75/manager/0.log" Jun 11 14:35:33.095546 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:33.095518 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rm229_f7f42549-1a4e-47fa-b628-73554a693756/server/0.log" Jun 11 14:35:33.223675 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:33.223602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-n26bk_29993c28-22b1-4ff1-a066-7d88dd1dbec5/manager/0.log" Jun 11 14:35:33.358974 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:33.358947 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-888kv_2a99af8d-99ec-4080-afc3-333f5dc96487/copy-manifests/0.log" Jun 11 14:35:33.379117 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:33.379075 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-888kv_2a99af8d-99ec-4080-afc3-333f5dc96487/manager/0.log" Jun 11 14:35:35.432420 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:35.432393 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-czt99_fa6ab70e-5126-47a6-a800-91810a922468/manager/0.log" Jun 11 14:35:36.696528 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:36.696495 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7drv5_71ce5fb2-fb46-433c-a233-12fcb1b5eb25/discovery/0.log" Jun 11 14:35:36.833799 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:36.833768 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d5469cdd-mxdxj_15384b62-7655-4420-9792-743943bfecf9/kube-auth-proxy/0.log" Jun 11 14:35:37.211328 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:37.211300 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hslg9_66a97514-a3be-4ccc-b564-e3ac6b5820b7/payload-pre-processing/0.log" Jun 11 14:35:38.004919 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.004882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-xrc27_b2b4951f-593c-4eb2-8ea2-d538812088f3/main/0.log" Jun 11 14:35:38.013344 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.013324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-xrc27_b2b4951f-593c-4eb2-8ea2-d538812088f3/storage-initializer/0.log" Jun 11 14:35:38.416601 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.416568 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kmg56_83346c5b-fd7e-4842-bbc7-fd93022e1d00/storage-initializer/0.log" Jun 11 14:35:38.423647 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.423627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-kmg56_83346c5b-fd7e-4842-bbc7-fd93022e1d00/main/0.log" Jun 11 14:35:38.550919 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.550888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-kkgx5_82fc10f4-e949-4093-acba-ad4525966a57/storage-initializer/0.log" Jun 11 14:35:38.559760 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:38.559739 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-kkgx5_82fc10f4-e949-4093-acba-ad4525966a57/main/0.log" Jun 11 14:35:43.278133 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:43.278097 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:43.375245 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:43.375210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:46.295827 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:46.295794 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtmtn_d3d8812a-32b3-4a5f-8c9b-9e83229a9043/global-pull-secret-syncer/0.log" Jun 11 14:35:46.393453 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:46.393424 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5pv28_d243aae0-e87b-474e-82f3-afd4976ee533/konnectivity-agent/0.log" Jun 11 14:35:46.529473 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:46.529430 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-224.ec2.internal_a14bb7d8ac0382fb9d1d5bb6274cccb3/haproxy/0.log" Jun 11 14:35:49.923505 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:49.923476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-sgqgc_5786bddc-3e31-4279-ac8e-bde368ed7f6b/sail-operator/0.log" Jun 11 14:35:51.444148 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:51.444103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-czt99_fa6ab70e-5126-47a6-a800-91810a922468/manager/0.log" Jun 11 14:35:53.975106 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:53.975063 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/node-exporter/0.log" Jun 11 14:35:54.015292 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.015259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/kube-rbac-proxy/0.log" Jun 11 14:35:54.052017 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.051991 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7zbc_fd56f0c1-e63b-42c0-b85e-9038a3470c39/init-textfile/0.log" Jun 11 14:35:54.096983 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.096950 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/kube-rbac-proxy-main/0.log" Jun 11 14:35:54.129110 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.129088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/kube-rbac-proxy-self/0.log" Jun 11 14:35:54.160768 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.160737 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j4wns_e7076beb-ed78-476e-99da-3947fd9c1f33/openshift-state-metrics/0.log" Jun 11 14:35:54.516665 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:54.516633 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kfzmw_37611ace-4989-4a58-aff4-bf1df7359629/prometheus-operator-admission-webhook/0.log" Jun 11 14:35:56.936975 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.936940 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw"] Jun 11 14:35:56.939894 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.939872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:56.942509 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.942491 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5jsz\"/\"default-dockercfg-bvk9d\"" Jun 11 14:35:56.942602 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.942569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jsz\"/\"kube-root-ca.crt\"" Jun 11 14:35:56.943406 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.943388 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jsz\"/\"openshift-service-ca.crt\"" Jun 11 14:35:56.950371 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:56.950351 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw"] Jun 11 14:35:57.013867 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.013825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-sys\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.014094 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.013887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkslm\" (UniqueName: \"kubernetes.io/projected/723dfb08-f66a-40a6-ac89-151eb9a2df16-kube-api-access-mkslm\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.014094 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.013954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-lib-modules\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.014094 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.014004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-podres\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.014094 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.014029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-proc\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115156 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-podres\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115156 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-proc\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-sys\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkslm\" (UniqueName: \"kubernetes.io/projected/723dfb08-f66a-40a6-ac89-151eb9a2df16-kube-api-access-mkslm\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-lib-modules\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-proc\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-podres\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115393 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-sys\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.115648 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.115443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/723dfb08-f66a-40a6-ac89-151eb9a2df16-lib-modules\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.123811 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.123779 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkslm\" (UniqueName: \"kubernetes.io/projected/723dfb08-f66a-40a6-ac89-151eb9a2df16-kube-api-access-mkslm\") pod \"perf-node-gather-daemonset-7hwzw\" (UID: \"723dfb08-f66a-40a6-ac89-151eb9a2df16\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.250748 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.250654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.388995 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.388962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw"] Jun 11 14:35:57.391594 ip-10-0-137-224 kubenswrapper[2580]: W0611 14:35:57.391564 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod723dfb08_f66a_40a6_ac89_151eb9a2df16.slice/crio-1933c379f97998ae4c3612bc126ebdd69b220fc4d44ba97eb94ba3088b26d162 WatchSource:0}: Error finding container 1933c379f97998ae4c3612bc126ebdd69b220fc4d44ba97eb94ba3088b26d162: Status 404 returned error can't find the container with id 1933c379f97998ae4c3612bc126ebdd69b220fc4d44ba97eb94ba3088b26d162 Jun 11 14:35:57.614764 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.614736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-fxssc_3268c440-9dae-46e4-83f9-41fc78246c14/download-server/0.log" Jun 11 14:35:57.674783 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.674739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" event={"ID":"723dfb08-f66a-40a6-ac89-151eb9a2df16","Type":"ContainerStarted","Data":"06e98c4321dffee33a80b5820228d1cd54a54b7e5f75fa7e95e40a4a893b1e27"} Jun 11 14:35:57.674956 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.674806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" event={"ID":"723dfb08-f66a-40a6-ac89-151eb9a2df16","Type":"ContainerStarted","Data":"1933c379f97998ae4c3612bc126ebdd69b220fc4d44ba97eb94ba3088b26d162"} Jun 11 14:35:57.675004 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.674962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:35:57.691787 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:57.691737 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" podStartSLOduration=1.6917216370000001 podStartE2EDuration="1.691721637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:35:57.689909549 +0000 UTC m=+1119.250563937" watchObservedRunningTime="2026-06-11 14:35:57.691721637 +0000 UTC m=+1119.252376027" Jun 11 14:35:59.598215 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:59.598185 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nkpqz_915a2b77-149f-4202-89ff-62b9c6283997/dns/0.log" Jun 11 14:35:59.619383 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:59.619360 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nkpqz_915a2b77-149f-4202-89ff-62b9c6283997/kube-rbac-proxy/0.log" Jun 11 14:35:59.714448 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:35:59.714418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dm2zr_32a1d6ee-a64c-40eb-aaca-44a2ed3daef3/dns-node-resolver/0.log" Jun 11 14:36:00.377407 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:00.377381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nsjmk_0a7d6e05-4f94-4bfe-974f-d29eb0acbead/node-ca/0.log" Jun 11 14:36:01.414145 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:01.414114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7drv5_71ce5fb2-fb46-433c-a233-12fcb1b5eb25/discovery/0.log" Jun 11 14:36:01.437249 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:01.437207 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d5469cdd-mxdxj_15384b62-7655-4420-9792-743943bfecf9/kube-auth-proxy/0.log" Jun 11 14:36:01.512275 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:01.512244 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hslg9_66a97514-a3be-4ccc-b564-e3ac6b5820b7/payload-pre-processing/0.log" Jun 11 14:36:02.240205 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:02.240173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlh89_a480903b-60e9-4366-a942-e59914f55f9b/serve-healthcheck-canary/0.log" Jun 11 14:36:02.771922 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:02.771883 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmnh_fb0b700d-50e9-44e9-a439-76a497b38b2c/kube-rbac-proxy/0.log" Jun 11 14:36:02.795465 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:02.795438 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmnh_fb0b700d-50e9-44e9-a439-76a497b38b2c/exporter/0.log" Jun 11 14:36:02.817851 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:02.817824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gmnh_fb0b700d-50e9-44e9-a439-76a497b38b2c/extractor/0.log" Jun 11 14:36:03.689340 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:03.689312 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-7hwzw" Jun 11 14:36:05.430965 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.430932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56997bdbdf-k4bmv_85dd3545-815a-46db-9405-1addb210362f/nginx/0.log" Jun 11 14:36:05.458819 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.458791 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z872g_a45fb5ff-495b-4109-9828-c48e2c960d3f/manager/0.log" Jun 11 14:36:05.493695 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.493669 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6r5t4_441bbe20-ff15-4de9-9fac-58ff48fb2e75/manager/0.log" Jun 11 14:36:05.555267 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.555243 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-rm229_f7f42549-1a4e-47fa-b628-73554a693756/server/0.log" Jun 11 14:36:05.610462 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.610425 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-n26bk_29993c28-22b1-4ff1-a066-7d88dd1dbec5/manager/0.log" Jun 11 14:36:05.661548 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.661514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-888kv_2a99af8d-99ec-4080-afc3-333f5dc96487/manager/0.log" Jun 11 14:36:05.681240 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:05.681166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-888kv_2a99af8d-99ec-4080-afc3-333f5dc96487/copy-manifests/0.log" Jun 11 14:36:07.658702 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:07.658671 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2jjs7_0136b045-bb07-4814-9a22-67eb5b5bc26b/openshift-lws-operator/0.log" Jun 11 14:36:12.080995 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:12.080964 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7drv5_71ce5fb2-fb46-433c-a233-12fcb1b5eb25/discovery/0.log" Jun 11 14:36:12.092371 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:12.092343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d5469cdd-mxdxj_15384b62-7655-4420-9792-743943bfecf9/kube-auth-proxy/0.log" Jun 11 14:36:12.142971 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:12.142946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hslg9_66a97514-a3be-4ccc-b564-e3ac6b5820b7/payload-pre-processing/0.log" Jun 11 14:36:13.358068 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:13.358025 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7drv5_71ce5fb2-fb46-433c-a233-12fcb1b5eb25/discovery/0.log" Jun 11 14:36:13.368885 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:13.368865 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d5469cdd-mxdxj_15384b62-7655-4420-9792-743943bfecf9/kube-auth-proxy/0.log" Jun 11 14:36:13.422489 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:13.422457 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hslg9_66a97514-a3be-4ccc-b564-e3ac6b5820b7/payload-pre-processing/0.log" Jun 11 14:36:14.786952 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:14.786920 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h8zrq_d5b54f23-835a-49a0-be44-c01200150da7/kube-multus-additional-cni-plugins/0.log" Jun 11 14:36:14.816700 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:14.816674 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h8zrq_d5b54f23-835a-49a0-be44-c01200150da7/egress-router-binary-copy/0.log" Jun 11 14:36:14.838698 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:14.838671 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h8zrq_d5b54f23-835a-49a0-be44-c01200150da7/cni-plugins/0.log" Jun 11 14:36:14.863625 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:14.863602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h8zrq_d5b54f23-835a-49a0-be44-c01200150da7/bond-cni-plugin/0.log" Jun 11 14:36:14.886255 ip-10-0-137-224 kubenswrapper[2580]: I0611 14:36:14.886220 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h8zrq_d5b54f23-835a-49a0-be44-c01200150da7/routeoverride-cni/0.log"