Jun 09 13:41:56.525706 ip-10-0-137-34 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 13:41:56.525723 ip-10-0-137-34 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 13:41:56.525734 ip-10-0-137-34 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 13:41:56.526048 ip-10-0-137-34 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 13:42:06.628276 ip-10-0-137-34 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 13:42:06.628292 ip-10-0-137-34 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fd64e6b5e1de4ff289110de1a5d5c356 -- Jun 09 13:44:31.525903 ip-10-0-137-34 systemd[1]: Starting Kubernetes Kubelet... Jun 09 13:44:31.951681 ip-10-0-137-34 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:44:31.951681 ip-10-0-137-34 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 13:44:31.951681 ip-10-0-137-34 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:44:31.951681 ip-10-0-137-34 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 13:44:31.951681 ip-10-0-137-34 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 13:44:31.953592 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.951814 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 13:44:31.958603 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958587 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.958603 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958602 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958609 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958614 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958617 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958621 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958624 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958627 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958630 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958632 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958635 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958638 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958640 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958643 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958646 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958648 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958651 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958653 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958656 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958659 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958661 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.958671 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958664 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958666 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958669 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958671 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958674 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958677 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958680 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958686 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958689 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958691 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958694 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958697 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958699 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958702 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958704 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958708 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958712 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958715 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958718 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958721 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.959141 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958723 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958726 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958728 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958731 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958733 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958736 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958739 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958742 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958744 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958747 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958750 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958753 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958755 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958759 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958762 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958765 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958767 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958770 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958772 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958775 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.959638 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958778 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958780 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958783 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958786 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958789 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958791 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958794 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958797 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958800 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958802 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958805 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958807 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958810 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958813 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958815 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958818 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958820 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958824 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958827 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958830 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.960165 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958832 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958835 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958838 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958840 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958843 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958846 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958849 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958851 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958854 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958857 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958859 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958862 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958864 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958867 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958870 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958872 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958875 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.958879 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959642 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959649 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.960650 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959653 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959656 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959659 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959662 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959665 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959669 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959673 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959676 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959679 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959681 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959684 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959687 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959690 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959693 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959696 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959698 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959701 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959704 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959707 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.961150 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959711 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959713 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959716 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959719 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959722 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959724 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959727 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959729 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959732 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959736 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959740 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959744 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959747 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959749 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959752 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959755 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959757 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959760 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959763 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.961639 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959765 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959769 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959772 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959774 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959777 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959780 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959783 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959786 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959788 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959791 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959793 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959796 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959800 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959803 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959805 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959808 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959811 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959814 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959816 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.962104 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959819 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959822 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959824 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959828 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959830 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959833 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959835 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959838 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959841 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959843 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959846 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959848 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959851 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959854 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959856 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959859 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959862 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959865 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959868 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959871 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.962586 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959873 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959876 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959879 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959882 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959886 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959888 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959891 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959893 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959896 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959898 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959901 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959903 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959906 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959908 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959911 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959914 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959916 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959919 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959921 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.959924 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.963073 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960295 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960300 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960304 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960307 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960310 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960312 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960315 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960317 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960320 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960322 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960325 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960328 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960330 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960333 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960337 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960340 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960343 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960346 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960349 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.963655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960352 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960354 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960357 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960359 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960362 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960365 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960367 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960370 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960372 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960375 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960377 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960380 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960382 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960385 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960387 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960390 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960392 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960395 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960397 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960400 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.964114 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960403 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960405 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960408 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960411 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960415 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960417 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960420 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960423 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960426 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960429 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960432 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960434 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960437 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960440 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960442 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960444 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960447 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960455 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960458 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960475 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.964641 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960478 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960480 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960483 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960486 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960488 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960491 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960493 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960496 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960498 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960501 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960503 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960506 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960508 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960511 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960514 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960516 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960519 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960521 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960524 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960528 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.965139 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960531 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960534 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960537 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960539 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960543 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960547 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960550 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960553 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960556 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960560 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960563 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960565 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960569 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960571 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960574 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960577 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960579 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960582 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960585 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.960587 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.965653 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960653 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960660 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960666 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960679 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960683 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960686 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960690 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960695 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960698 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960701 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960707 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960710 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960713 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960717 2578 flags.go:64] FLAG: --cgroup-root="" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960720 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960723 2578 flags.go:64] FLAG: --client-ca-file="" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960726 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960729 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960734 2578 flags.go:64] FLAG: --cluster-domain="" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960737 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960740 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960745 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960748 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960752 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 13:44:31.966137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960755 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960758 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960761 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960764 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960767 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960770 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960773 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960776 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960780 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960783 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960786 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960789 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960792 2578 flags.go:64] FLAG: --enable-server="true" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960795 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960799 2578 flags.go:64] FLAG: --event-burst="100" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960802 2578 flags.go:64] FLAG: --event-qps="50" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960805 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960808 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960813 2578 flags.go:64] FLAG: --eviction-hard="" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960816 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960819 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960823 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960826 2578 flags.go:64] FLAG: --eviction-soft="" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960829 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960832 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 13:44:31.966751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960835 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960838 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960841 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960843 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960848 2578 flags.go:64] FLAG: --feature-gates="" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960852 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960855 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960858 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960861 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960864 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960867 2578 flags.go:64] FLAG: --help="false" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960870 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-137-34.ec2.internal" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960873 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960875 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960878 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960881 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960885 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960888 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960890 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960893 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960896 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960899 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960902 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960905 2578 flags.go:64] FLAG: --kube-reserved="" Jun 09 13:44:31.967409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960907 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960912 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960915 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960918 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960921 2578 flags.go:64] FLAG: --lock-file="" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960923 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960927 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960930 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960936 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960939 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960941 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960944 2578 flags.go:64] FLAG: --logging-format="text" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960948 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960952 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960955 2578 flags.go:64] FLAG: --manifest-url="" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960958 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960962 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960965 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960968 2578 flags.go:64] FLAG: --max-pods="110" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960971 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960974 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960977 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960980 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960983 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960986 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 13:44:31.968003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960990 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960996 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.960999 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961002 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961005 2578 flags.go:64] FLAG: --pod-cidr="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961008 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961013 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961020 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961023 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961027 2578 flags.go:64] FLAG: --port="10250" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961030 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961033 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0df3eea36812aabea" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961036 2578 flags.go:64] FLAG: --qos-reserved="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961039 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961043 2578 flags.go:64] FLAG: --register-node="true" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961046 2578 flags.go:64] FLAG: --register-with-taints="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961049 2578 flags.go:64] FLAG: --registry-burst="10" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961052 2578 flags.go:64] FLAG: --registry-qps="5" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961055 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961060 2578 flags.go:64] FLAG: --reserved-memory="" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961074 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961078 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961081 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961083 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961086 2578 flags.go:64] FLAG: --runonce="false" Jun 09 13:44:31.968618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961089 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961093 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961096 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961099 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961101 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961104 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961108 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961111 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961113 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961116 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961119 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961122 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961125 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961128 2578 flags.go:64] FLAG: --system-cgroups="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961130 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961137 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961141 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961144 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961149 2578 flags.go:64] FLAG: --tls-min-version="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961152 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961155 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961158 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961161 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961164 2578 flags.go:64] FLAG: --v="2" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961169 2578 flags.go:64] FLAG: --version="false" Jun 09 13:44:31.969238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961172 2578 flags.go:64] FLAG: --vmodule="" Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961177 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.961180 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961290 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961294 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961296 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961299 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961302 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961304 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961307 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961310 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961312 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961315 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961318 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961320 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961323 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961326 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961329 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961331 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961334 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.969876 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961337 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961339 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961342 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961346 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961348 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961353 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961357 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961360 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961363 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961366 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961369 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961371 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961374 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961377 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961380 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961382 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961385 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961388 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961390 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.970374 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961393 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961396 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961398 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961401 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961403 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961406 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961409 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961411 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961414 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961416 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961419 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961421 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961424 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961426 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961429 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961431 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961435 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961437 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961440 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.970868 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961442 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961445 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961448 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961452 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961455 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961459 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961479 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961482 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961485 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961488 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961491 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961494 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961497 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961500 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961503 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961506 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961508 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961511 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961513 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.971337 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961516 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961519 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961521 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961524 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961527 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961529 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961532 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961535 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961538 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961540 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961544 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961547 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961549 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961552 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961556 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961559 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961562 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961564 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961567 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.971912 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961570 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961573 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961576 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961578 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961581 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.961584 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.962188 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.968917 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.968935 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.968948 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.968954 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969011 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969017 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969021 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969024 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.972371 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969027 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969030 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969033 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969035 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969039 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969043 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969046 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969049 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969052 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969055 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969058 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969068 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969071 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969075 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969079 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969082 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969084 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969088 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969091 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.972765 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969093 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969096 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969099 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969101 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969104 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969107 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969110 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969113 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969116 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969119 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969121 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969126 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969129 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969132 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969135 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969138 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969141 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969145 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969147 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.973238 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969150 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969153 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969155 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969158 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969160 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969163 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969166 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969169 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969171 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969174 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969177 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969179 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969183 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969186 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969188 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969191 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969193 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969196 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969198 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969202 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.973716 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969204 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969207 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969210 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969212 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969215 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969218 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969220 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969223 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969225 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969228 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969230 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969233 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969236 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969238 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969241 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969244 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969248 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969250 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969253 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969256 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.974192 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969258 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969261 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969264 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969266 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969269 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969272 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969275 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969277 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969280 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969282 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969285 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969288 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969290 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969293 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969296 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969298 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.974689 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969302 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.969307 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969435 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969440 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969444 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969448 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969451 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969454 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969457 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969479 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969484 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969487 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969490 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969492 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969495 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 13:44:31.975072 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969498 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969500 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969503 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969506 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969508 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969511 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969514 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969518 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969520 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969523 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969526 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969528 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969531 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969534 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969537 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969539 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969542 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969545 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969547 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969550 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 13:44:31.975435 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969553 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969555 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969558 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969560 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969563 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969566 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969568 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969571 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969573 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969576 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969578 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969581 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969583 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969588 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969596 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969598 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969601 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969603 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969606 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 13:44:31.975937 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969609 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969611 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969614 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969616 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969622 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969625 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969627 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969630 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969633 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969636 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969638 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969640 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969643 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969646 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969648 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969651 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969654 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969656 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 13:44:31.976409 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969659 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969661 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969664 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969666 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969668 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969671 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969674 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969676 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969679 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969682 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969684 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969687 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969689 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969693 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969697 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969700 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969703 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969706 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969709 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 13:44:31.976881 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969711 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969714 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969718 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969721 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969724 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969727 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969729 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:31.969732 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.969737 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.969840 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.973381 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.974964 2578 server.go:1019] "Starting client certificate rotation" Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.975065 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:44:31.977386 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.975101 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 13:44:31.977730 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.977662 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:44:31.979354 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.979243 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 13:44:31.989513 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.989488 2578 log.go:25] "Validated CRI v1 runtime API" Jun 09 13:44:31.992214 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.992201 2578 log.go:25] "Validated CRI v1 image API" Jun 09 13:44:31.995812 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.995784 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 13:44:31.998080 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.998063 2578 fs.go:135] Filesystem UUIDs: map[356942cb-1351-4b1a-aff3-295ed8edb376:/dev/nvme0n1p4 73c08344-34a9-4bed-ba2a-6ef3e227924e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 13:44:31.998149 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:31.998080 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 13:44:32.004251 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.004135 2578 manager.go:216] Machine: {Timestamp:2026-06-09 13:44:32.002682282 +0000 UTC m=+0.347632632 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100248 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2377afc7f3fb7336767c65d3bcdce4 SystemUUID:ec2377af-c7f3-fb73-3676-7c65d3bcdce4 BootID:fd64e6b5-e1de-4ff2-8911-0de1a5d5c356 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:8d:95:4a:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:8d:95:4a:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:6e:ca:76:43:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 13:44:32.004251 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.004238 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 13:44:32.004409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.004318 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 13:44:32.006266 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.006251 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:44:32.007244 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.007219 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 13:44:32.007378 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.007247 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 13:44:32.007990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.007979 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 13:44:32.008031 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.007993 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 13:44:32.008031 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.008001 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:44:32.008789 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.008778 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 13:44:32.009560 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.009550 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 13:44:32.012163 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012145 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:44:32.012270 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012258 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 13:44:32.012312 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012288 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 09 13:44:32.012312 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012298 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 13:44:32.012312 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012311 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 13:44:32.012423 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012322 2578 kubelet.go:398] "Adding apiserver pod source" Jun 09 13:44:32.012423 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012331 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 13:44:32.012694 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012683 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:44:32.012728 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.012701 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 13:44:32.015783 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.015756 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 13:44:32.017254 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017241 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 13:44:32.017304 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017271 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 13:44:32.017870 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017859 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 13:44:32.017905 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017882 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 13:44:32.017905 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017888 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 13:44:32.017905 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017894 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 13:44:32.017905 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017904 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017909 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017917 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017923 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017930 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017935 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017947 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 13:44:32.018013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.017952 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 13:44:32.018737 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.018725 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 13:44:32.018779 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.018739 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 13:44:32.021809 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.021793 2578 server.go:1268] "Started kubelet" Jun 09 13:44:32.021931 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.021873 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 13:44:32.021996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.021957 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 13:44:32.022049 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.021993 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 13:44:32.022753 ip-10-0-137-34 systemd[1]: Started Kubernetes Kubelet. Jun 09 13:44:32.025170 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.025145 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 13:44:32.025436 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.025410 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 13:44:32.025561 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.025414 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 13:44:32.025734 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.025702 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 13:44:32.027213 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.027195 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 09 13:44:32.029731 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.029701 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 13:44:32.031383 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.030416 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-34.ec2.internal.18b76d96c853a35d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-34.ec2.internal,UID:ip-10-0-137-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-34.ec2.internal,},FirstTimestamp:2026-06-09 13:44:32.021767005 +0000 UTC m=+0.366717333,LastTimestamp:2026-06-09 13:44:32.021767005 +0000 UTC m=+0.366717333,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-34.ec2.internal,}" Jun 09 13:44:32.031455 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.031440 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 13:44:32.031455 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.031445 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 13:44:32.031578 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.031562 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.032070 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032052 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 13:44:32.032220 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032198 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 13:44:32.032294 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032222 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 13:44:32.032294 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032277 2578 factory.go:55] Registering systemd factory Jun 09 13:44:32.032294 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032292 2578 factory.go:223] Registration of the systemd container factory successfully Jun 09 13:44:32.032427 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032322 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 09 13:44:32.032427 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032332 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 09 13:44:32.032555 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032545 2578 factory.go:153] Registering CRI-O factory Jun 09 13:44:32.032606 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032559 2578 factory.go:223] Registration of the crio container factory successfully Jun 09 13:44:32.032653 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032605 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 13:44:32.032653 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032631 2578 factory.go:103] Registering Raw factory Jun 09 13:44:32.032653 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.032646 2578 manager.go:1196] Started watching for new ooms in manager Jun 09 13:44:32.033074 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.033050 2578 manager.go:349] Starting recovery of all containers Jun 09 13:44:32.038876 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.038838 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 13:44:32.038990 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.038964 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 13:44:32.041242 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.041219 2578 manager.go:354] Recovery completed Jun 09 13:44:32.045791 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.045678 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.047551 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.047534 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.047636 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.047567 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.047636 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.047585 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.048094 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048081 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 13:44:32.048094 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048094 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 13:44:32.048175 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048109 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 13:44:32.048175 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048139 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.048895 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048878 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.048997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048904 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.048997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.048914 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.049347 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.049336 2578 policy_none.go:49] "None policy: Start" Jun 09 13:44:32.049378 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.049360 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 13:44:32.049378 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.049370 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 13:44:32.049832 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.049761 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-34.ec2.internal.18b76d96c9dd0f0a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-34.ec2.internal,UID:ip-10-0-137-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-34.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-34.ec2.internal,},FirstTimestamp:2026-06-09 13:44:32.047550218 +0000 UTC m=+0.392500550,LastTimestamp:2026-06-09 13:44:32.047550218 +0000 UTC m=+0.392500550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-34.ec2.internal,}" Jun 09 13:44:32.050290 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.050278 2578 policy_none.go:47] "Start" Jun 09 13:44:32.054806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.054788 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dkfd" Jun 09 13:44:32.060698 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.060637 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-34.ec2.internal.18b76d96c9dd6ad7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-34.ec2.internal,UID:ip-10-0-137-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-34.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-34.ec2.internal,},FirstTimestamp:2026-06-09 13:44:32.047573719 +0000 UTC m=+0.392524048,LastTimestamp:2026-06-09 13:44:32.047573719 +0000 UTC m=+0.392524048,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-34.ec2.internal,}" Jun 09 13:44:32.062708 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.062692 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8dkfd" Jun 09 13:44:32.088030 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088012 2578 manager.go:337] "Starting Device Plugin manager" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.088045 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088054 2578 server.go:87] "Starting device plugin registration server" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088297 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088310 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088407 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088509 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.088520 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.089089 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.089134 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.099438 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.100593 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.100648 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.100666 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 13:44:32.102546 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.100732 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 13:44:32.103124 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.102842 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:44:32.188901 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.188873 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.189902 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.189885 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.189996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.189919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.189996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.189934 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.189996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.189964 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.198815 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.198793 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.198881 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.198818 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-34.ec2.internal\": node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.201070 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.201054 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal"] Jun 09 13:44:32.201138 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.201124 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.202628 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.202541 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.202628 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.202570 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.202628 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.202584 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.203661 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.203649 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.203817 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.203801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.203869 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.203834 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.204390 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204375 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.204482 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204393 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.204482 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204405 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.204482 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204417 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.204575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204417 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.204575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.204557 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.205628 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.205614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.205670 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.205639 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:32.206293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.206279 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:32.206357 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.206301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:32.206357 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.206311 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:32.227112 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.227088 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.230147 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.230130 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-34.ec2.internal\" not found" node="ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.232884 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.232821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aa2be1dfc9f4320165bfbdb55271e05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-34.ec2.internal\" (UID: \"7aa2be1dfc9f4320165bfbdb55271e05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.232884 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.232845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.232978 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.232897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.234559 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.234537 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-34.ec2.internal\" not found" node="ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.327232 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.327195 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.333499 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.333630 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aa2be1dfc9f4320165bfbdb55271e05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-34.ec2.internal\" (UID: \"7aa2be1dfc9f4320165bfbdb55271e05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.333630 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.333630 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.333630 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aa2be1dfc9f4320165bfbdb55271e05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-34.ec2.internal\" (UID: \"7aa2be1dfc9f4320165bfbdb55271e05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.333630 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.333570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1caf063587a22404590bca7c75bcac4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal\" (UID: \"e1caf063587a22404590bca7c75bcac4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.427624 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.427599 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.528425 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.528343 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.534666 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.534643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.538586 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.538572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:32.628529 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.628495 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.729041 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.729010 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.829583 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.829486 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.929975 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:32.929941 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:32.974391 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.974359 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 13:44:32.974885 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.974553 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 13:44:32.993786 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:32.993759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1caf063587a22404590bca7c75bcac4.slice/crio-730c83256c27ad03443a4016977bac3a86397114e1059b2c830095d1ac43568d WatchSource:0}: Error finding container 730c83256c27ad03443a4016977bac3a86397114e1059b2c830095d1ac43568d: Status 404 returned error can't find the container with id 730c83256c27ad03443a4016977bac3a86397114e1059b2c830095d1ac43568d Jun 09 13:44:32.994229 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:32.994210 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa2be1dfc9f4320165bfbdb55271e05.slice/crio-732638eb7afbcc2a0dddbe72812d9cb1fc6b70340bb9339478a1aff911b0ec7d WatchSource:0}: Error finding container 732638eb7afbcc2a0dddbe72812d9cb1fc6b70340bb9339478a1aff911b0ec7d: Status 404 returned error can't find the container with id 732638eb7afbcc2a0dddbe72812d9cb1fc6b70340bb9339478a1aff911b0ec7d Jun 09 13:44:32.999992 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:32.999978 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:44:33.030363 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:33.030338 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:33.065400 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.065369 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 13:39:32 +0000 UTC" deadline="2027-12-25 01:30:02.605715234 +0000 UTC" Jun 09 13:44:33.065400 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.065395 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13523h45m29.540323338s" Jun 09 13:44:33.103794 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.103712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" event={"ID":"7aa2be1dfc9f4320165bfbdb55271e05","Type":"ContainerStarted","Data":"732638eb7afbcc2a0dddbe72812d9cb1fc6b70340bb9339478a1aff911b0ec7d"} Jun 09 13:44:33.104674 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.104653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" event={"ID":"e1caf063587a22404590bca7c75bcac4","Type":"ContainerStarted","Data":"730c83256c27ad03443a4016977bac3a86397114e1059b2c830095d1ac43568d"} Jun 09 13:44:33.130806 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:33.130785 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:33.181268 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.181244 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 13:44:33.182525 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.182508 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientMemory" Jun 09 13:44:33.182616 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.182549 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 13:44:33.182616 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.182560 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeHasSufficientPID" Jun 09 13:44:33.231603 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:33.231579 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-34.ec2.internal\" not found" Jun 09 13:44:33.266848 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.266825 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:44:33.310668 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.310641 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:44:33.331745 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.331720 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" Jun 09 13:44:33.344883 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.344859 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:44:33.346952 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.346923 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" Jun 09 13:44:33.353874 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.353811 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 13:44:33.495645 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.495608 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:44:33.879243 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:33.879212 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 13:44:34.013362 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.013320 2578 apiserver.go:52] "Watching apiserver" Jun 09 13:44:34.022358 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.022331 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 13:44:34.023587 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.023562 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-27lnz","openshift-multus/network-metrics-daemon-8qhgg","openshift-network-operator/iptables-alerter-cjmwl","kube-system/global-pull-secret-syncer-7npwn","kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp","openshift-cluster-node-tuning-operator/tuned-f5pqj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal","openshift-multus/multus-additional-cni-plugins-dwrml","openshift-network-diagnostics/network-check-target-7lmfv","openshift-ovn-kubernetes/ovnkube-node-6ff8g","kube-system/konnectivity-agent-nbhph","openshift-dns/node-resolver-6ghkr","openshift-image-registry/node-ca-gxfdw"] Jun 09 13:44:34.024839 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.024808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.026143 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.026125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.027291 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.027273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.027679 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.027636 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.027838 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.027809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64w2k\"" Jun 09 13:44:34.027916 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.027876 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.028455 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.028438 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 13:44:34.028553 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.028485 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.029652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.029716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.029783 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2vrk8\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.029791 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.029842 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 13:44:34.030235 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 13:44:34.030764 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ldddr\"" Jun 09 13:44:34.030764 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030442 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.030764 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.030904 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.030840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.032201 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.032181 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 13:44:34.032303 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.032285 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.033132 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.033112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.033261 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.033243 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.033324 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.033302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s5fwv\"" Jun 09 13:44:34.033380 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.033371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 13:44:34.035151 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.035019 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.035282 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.035257 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.035449 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.035437 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.035756 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.035730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 13:44:34.035900 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.035881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-54nvn\"" Jun 09 13:44:34.037026 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.036817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.038132 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.038112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 13:44:34.038393 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.038368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gkd8r\"" Jun 09 13:44:34.038488 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.038445 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.038623 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.038604 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.039228 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039102 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.039755 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2gnl\"" Jun 09 13:44:34.040176 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.039885 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-config\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-device-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-sys-fs\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-kubelet\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysconfig\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-systemd-units\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhkk\" (UniqueName: \"kubernetes.io/projected/f99b3f8f-55e9-466a-be87-1e46a7723c7c-kube-api-access-dnhkk\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-systemd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-ovn\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/855f1066-4992-41f8-bacc-577dad05f34c-host\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/855f1066-4992-41f8-bacc-577dad05f34c-serviceca\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.042796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-etc-selinux\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-os-release\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.042951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlq44\" (UniqueName: \"kubernetes.io/projected/570a7e3d-55be-4402-a77c-faaba0d794a6-kube-api-access-jlq44\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-run\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-host\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxxkf\" (UniqueName: \"kubernetes.io/projected/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-kube-api-access-mxxkf\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.043458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.043720 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-lib-modules\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.043720 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-tuned\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.043720 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-netns\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.043838 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.043740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-var-lib-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044261 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-env-overrides\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044344 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:34.044429 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.044402 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:34.044525 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-var-lib-kubelet\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.044581 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmq4\" (UniqueName: \"kubernetes.io/projected/855f1066-4992-41f8-bacc-577dad05f34c-kube-api-access-2pmq4\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.044581 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.044690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-cnibin\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.044690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-dbus\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.044690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.044690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-socket-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.044690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-node-log\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-slash\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-modprobe-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-kubernetes\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-host-slash\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-system-cni-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/570a7e3d-55be-4402-a77c-faaba0d794a6-ovn-node-metrics-cert\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-sys\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.044923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-script-lib\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-systemd\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.044990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-registration-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rll\" (UniqueName: \"kubernetes.io/projected/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kube-api-access-k5rll\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-kubelet-config\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-conf\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszts\" (UniqueName: \"kubernetes.io/projected/5b940780-c069-4d8d-ab26-ec35a783971d-kube-api-access-gszts\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-etc-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.045381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-log-socket\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.046014 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-netd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.046014 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-tmp\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.046014 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-bin\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.046014 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045537 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 13:44:34.046014 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.045539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-iptables-alerter-script\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.046244 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.046146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.047346 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.047323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.048665 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.048645 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 13:44:34.048763 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.048742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d6fbd\"" Jun 09 13:44:34.050053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.049869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p92jd\"" Jun 09 13:44:34.050117 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.050104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 13:44:34.050329 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.050309 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 13:44:34.067641 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.067617 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dfhnx" Jun 09 13:44:34.074256 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.074224 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dfhnx" Jun 09 13:44:34.133301 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.133246 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 13:44:34.145881 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.145849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-netd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.145897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-tmp\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.145949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.145979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-hostroot\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-bin\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-netd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-iptables-alerter-script\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef2585d4-4314-42f1-b86c-c43be883576e-agent-certs\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-conf-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-cni-bin\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-config\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-device-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-sys-fs\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.146365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-kubelet\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysconfig\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-systemd-units\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhkk\" (UniqueName: \"kubernetes.io/projected/f99b3f8f-55e9-466a-be87-1e46a7723c7c-kube-api-access-dnhkk\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cnibin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7xw5\" (UniqueName: \"kubernetes.io/projected/5cb95f79-c0b7-446e-a06e-7ab515c776d9-kube-api-access-g7xw5\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-kubelet\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-systemd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-systemd\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-ovn\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146706 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 13:44:34.146754 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysconfig\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-systemd-units\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-iptables-alerter-script\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-sys-fs\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-device-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-ovn\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.147293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.146701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/855f1066-4992-41f8-bacc-577dad05f34c-host\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/855f1066-4992-41f8-bacc-577dad05f34c-serviceca\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-etc-selinux\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-config\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-os-release\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlq44\" (UniqueName: \"kubernetes.io/projected/570a7e3d-55be-4402-a77c-faaba0d794a6-kube-api-access-jlq44\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-run\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-host\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxxkf\" (UniqueName: \"kubernetes.io/projected/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-kube-api-access-mxxkf\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-k8s-cni-cncf-io\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cb95f79-c0b7-446e-a06e-7ab515c776d9-hosts-file\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-lib-modules\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.147658 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-tuned\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-system-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cni-binary-copy\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-netns\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-kubelet\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-netns\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/855f1066-4992-41f8-bacc-577dad05f34c-serviceca\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-os-release\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-var-lib-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/855f1066-4992-41f8-bacc-577dad05f34c-host\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-env-overrides\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-var-lib-kubelet\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-etc-selinux\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmq4\" (UniqueName: \"kubernetes.io/projected/855f1066-4992-41f8-bacc-577dad05f34c-kube-api-access-2pmq4\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-os-release\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-cnibin\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.148309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.147992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-multus\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-dbus\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-socket-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-etc-kubernetes\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-node-log\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-slash\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-run\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-modprobe-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-kubernetes\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-lib-modules\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-netns\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-slash\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-var-lib-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148483 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-kubernetes\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-modprobe-d\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-host-slash\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-cnibin\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-multus-certs\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-node-log\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148633 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-socket-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-dbus\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-system-cni-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b940780-c069-4d8d-ab26-ec35a783971d-system-cni-dir\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9hq\" (UniqueName: \"kubernetes.io/projected/5a70770c-9b14-4b70-bb29-5c7560b6acb3-kube-api-access-qk9hq\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-host\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb95f79-c0b7-446e-a06e-7ab515c776d9-tmp-dir\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.148776 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148831 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-var-lib-kubelet\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.149940 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.148874 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:34.648833711 +0000 UTC m=+2.993784043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/570a7e3d-55be-4402-a77c-faaba0d794a6-ovn-node-metrics-cert\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.148946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-host-slash\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-env-overrides\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-sys\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef2585d4-4314-42f1-b86c-c43be883576e-konnectivity-ca\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-sys\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-daemon-config\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-script-lib\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-run-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.149494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-systemd\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.150579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-registration-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rll\" (UniqueName: \"kubernetes.io/projected/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kube-api-access-k5rll\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/302fa1e8-1389-464f-a6ce-2a2e4f8517df-registration-dir\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.150833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.151192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/570a7e3d-55be-4402-a77c-faaba0d794a6-ovnkube-script-lib\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.151508 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.151561 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-systemd\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.151599 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-kubelet-config\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.151633 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-conf\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.151679 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.151734 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszts\" (UniqueName: \"kubernetes.io/projected/5b940780-c069-4d8d-ab26-ec35a783971d-kube-api-access-gszts\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.151785 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z44l\" (UniqueName: \"kubernetes.io/projected/37ce0a49-a45f-4d83-b916-a7db6704ca11-kube-api-access-2z44l\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.151835 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-socket-dir-parent\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.151886 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-tuned\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.151886 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-bin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.151985 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-etc-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.151985 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-log-socket\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.151985 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.151954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3e7cb8e-453b-4142-9626-66cdd842f114-kubelet-config\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.152165 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.152125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f99b3f8f-55e9-466a-be87-1e46a7723c7c-etc-sysctl-conf\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.152773 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.152434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-etc-openvswitch\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.152773 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.152523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-log-socket\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.152773 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.152608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-binary-copy\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.153043 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.152842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/570a7e3d-55be-4402-a77c-faaba0d794a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.153219 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.153191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b940780-c069-4d8d-ab26-ec35a783971d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.154908 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.154366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/570a7e3d-55be-4402-a77c-faaba0d794a6-ovn-node-metrics-cert\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.157034 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.156905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99b3f8f-55e9-466a-be87-1e46a7723c7c-tmp\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.158436 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.158379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmq4\" (UniqueName: \"kubernetes.io/projected/855f1066-4992-41f8-bacc-577dad05f34c-kube-api-access-2pmq4\") pod \"node-ca-gxfdw\" (UID: \"855f1066-4992-41f8-bacc-577dad05f34c\") " pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.158546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.158515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhkk\" (UniqueName: \"kubernetes.io/projected/f99b3f8f-55e9-466a-be87-1e46a7723c7c-kube-api-access-dnhkk\") pod \"tuned-f5pqj\" (UID: \"f99b3f8f-55e9-466a-be87-1e46a7723c7c\") " pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.160138 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.160088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxxkf\" (UniqueName: \"kubernetes.io/projected/1aabe04b-fdf9-4a44-b1db-7dfcde35be6f-kube-api-access-mxxkf\") pod \"iptables-alerter-cjmwl\" (UID: \"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f\") " pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.160294 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.160275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszts\" (UniqueName: \"kubernetes.io/projected/5b940780-c069-4d8d-ab26-ec35a783971d-kube-api-access-gszts\") pod \"multus-additional-cni-plugins-dwrml\" (UID: \"5b940780-c069-4d8d-ab26-ec35a783971d\") " pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.160751 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.160718 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlq44\" (UniqueName: \"kubernetes.io/projected/570a7e3d-55be-4402-a77c-faaba0d794a6-kube-api-access-jlq44\") pod \"ovnkube-node-6ff8g\" (UID: \"570a7e3d-55be-4402-a77c-faaba0d794a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.161765 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.161747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rll\" (UniqueName: \"kubernetes.io/projected/302fa1e8-1389-464f-a6ce-2a2e4f8517df-kube-api-access-k5rll\") pod \"aws-ebs-csi-driver-node-gd6pp\" (UID: \"302fa1e8-1389-464f-a6ce-2a2e4f8517df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.253321 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cnibin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7xw5\" (UniqueName: \"kubernetes.io/projected/5cb95f79-c0b7-446e-a06e-7ab515c776d9-kube-api-access-g7xw5\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-k8s-cni-cncf-io\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cb95f79-c0b7-446e-a06e-7ab515c776d9-hosts-file\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cnibin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5cb95f79-c0b7-446e-a06e-7ab515c776d9-hosts-file\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-k8s-cni-cncf-io\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253520 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-system-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cni-binary-copy\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-netns\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-kubelet\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-os-release\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-netns\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-system-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-multus\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-kubelet\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-etc-kubernetes\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-os-release\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-multus\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-multus-certs\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-etc-kubernetes\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9hq\" (UniqueName: \"kubernetes.io/projected/5a70770c-9b14-4b70-bb29-5c7560b6acb3-kube-api-access-qk9hq\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb95f79-c0b7-446e-a06e-7ab515c776d9-tmp-dir\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef2585d4-4314-42f1-b86c-c43be883576e-konnectivity-ca\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.253880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-run-multus-certs\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.253896 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.253965 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:34.753946014 +0000 UTC m=+3.098896347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.253903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-daemon-config\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z44l\" (UniqueName: \"kubernetes.io/projected/37ce0a49-a45f-4d83-b916-a7db6704ca11-kube-api-access-2z44l\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-socket-dir-parent\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-bin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-hostroot\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-cni-binary-copy\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef2585d4-4314-42f1-b86c-c43be883576e-agent-certs\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-conf-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-socket-dir-parent\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-conf-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-daemon-config\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-host-var-lib-cni-bin\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-multus-cni-dir\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.254716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb95f79-c0b7-446e-a06e-7ab515c776d9-tmp-dir\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.255508 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a70770c-9b14-4b70-bb29-5c7560b6acb3-hostroot\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.255508 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.254691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef2585d4-4314-42f1-b86c-c43be883576e-konnectivity-ca\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.257024 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.257004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef2585d4-4314-42f1-b86c-c43be883576e-agent-certs\") pod \"konnectivity-agent-nbhph\" (UID: \"ef2585d4-4314-42f1-b86c-c43be883576e\") " pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.266570 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.266537 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:34.266570 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.266570 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:34.266724 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.266584 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:34.266724 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.266708 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:34.766688305 +0000 UTC m=+3.111638620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:34.269671 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.269647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7xw5\" (UniqueName: \"kubernetes.io/projected/5cb95f79-c0b7-446e-a06e-7ab515c776d9-kube-api-access-g7xw5\") pod \"node-resolver-6ghkr\" (UID: \"5cb95f79-c0b7-446e-a06e-7ab515c776d9\") " pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.269788 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.269649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z44l\" (UniqueName: \"kubernetes.io/projected/37ce0a49-a45f-4d83-b916-a7db6704ca11-kube-api-access-2z44l\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.270027 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.269998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9hq\" (UniqueName: \"kubernetes.io/projected/5a70770c-9b14-4b70-bb29-5c7560b6acb3-kube-api-access-qk9hq\") pod \"multus-27lnz\" (UID: \"5a70770c-9b14-4b70-bb29-5c7560b6acb3\") " pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.338782 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.338631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" Jun 09 13:44:34.345900 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.345877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:34.355568 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.355541 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cjmwl" Jun 09 13:44:34.362163 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.362142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gxfdw" Jun 09 13:44:34.370807 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.370786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" Jun 09 13:44:34.380632 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.380612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dwrml" Jun 09 13:44:34.388316 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.388275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6ghkr" Jun 09 13:44:34.395809 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.395793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27lnz" Jun 09 13:44:34.400383 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.400368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:34.656364 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.656280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:34.656537 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.656433 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:34.656537 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.656528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:35.656503417 +0000 UTC m=+4.001453746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:34.757398 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.757368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:34.757543 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.757528 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:34.757599 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.757586 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:35.757572505 +0000 UTC m=+4.102522820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:34.777970 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.777947 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a70770c_9b14_4b70_bb29_5c7560b6acb3.slice/crio-88cb4b327383b251a403716db20e00bc272723031000106bdbe5783598f4014a WatchSource:0}: Error finding container 88cb4b327383b251a403716db20e00bc272723031000106bdbe5783598f4014a: Status 404 returned error can't find the container with id 88cb4b327383b251a403716db20e00bc272723031000106bdbe5783598f4014a Jun 09 13:44:34.778634 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.778597 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302fa1e8_1389_464f_a6ce_2a2e4f8517df.slice/crio-c1bf8805dbeb112b3434d058c9b0ec5e780f966c9808aaef3f14615cb8a16666 WatchSource:0}: Error finding container c1bf8805dbeb112b3434d058c9b0ec5e780f966c9808aaef3f14615cb8a16666: Status 404 returned error can't find the container with id c1bf8805dbeb112b3434d058c9b0ec5e780f966c9808aaef3f14615cb8a16666 Jun 09 13:44:34.781524 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.781488 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2585d4_4314_42f1_b86c_c43be883576e.slice/crio-7998e405ba4cda0a4d5d2c54262b076884b485ea58f0b8616408d3bdaac95c9c WatchSource:0}: Error finding container 7998e405ba4cda0a4d5d2c54262b076884b485ea58f0b8616408d3bdaac95c9c: Status 404 returned error can't find the container with id 7998e405ba4cda0a4d5d2c54262b076884b485ea58f0b8616408d3bdaac95c9c Jun 09 13:44:34.784016 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.783990 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb95f79_c0b7_446e_a06e_7ab515c776d9.slice/crio-4bf3709e71ade0ca23afbd23f670ac3155c88d53bdf6a87e61403e6ec7a52117 WatchSource:0}: Error finding container 4bf3709e71ade0ca23afbd23f670ac3155c88d53bdf6a87e61403e6ec7a52117: Status 404 returned error can't find the container with id 4bf3709e71ade0ca23afbd23f670ac3155c88d53bdf6a87e61403e6ec7a52117 Jun 09 13:44:34.784649 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.784525 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855f1066_4992_41f8_bacc_577dad05f34c.slice/crio-84a0aab06a5a38512b0bdc1733a47f847cb7c5d069b03b5cd9691131ae17def2 WatchSource:0}: Error finding container 84a0aab06a5a38512b0bdc1733a47f847cb7c5d069b03b5cd9691131ae17def2: Status 404 returned error can't find the container with id 84a0aab06a5a38512b0bdc1733a47f847cb7c5d069b03b5cd9691131ae17def2 Jun 09 13:44:34.785412 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.785295 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aabe04b_fdf9_4a44_b1db_7dfcde35be6f.slice/crio-893aa96a239d7728c8b551e406d9dcff9811431a5983d4fc8831417788e3e6ae WatchSource:0}: Error finding container 893aa96a239d7728c8b551e406d9dcff9811431a5983d4fc8831417788e3e6ae: Status 404 returned error can't find the container with id 893aa96a239d7728c8b551e406d9dcff9811431a5983d4fc8831417788e3e6ae Jun 09 13:44:34.805295 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.805272 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b940780_c069_4d8d_ab26_ec35a783971d.slice/crio-b7eda7ed50512ebf29e3d6b835d637871c3caf53343a11867a1ab874e324b7c8 WatchSource:0}: Error finding container b7eda7ed50512ebf29e3d6b835d637871c3caf53343a11867a1ab874e324b7c8: Status 404 returned error can't find the container with id b7eda7ed50512ebf29e3d6b835d637871c3caf53343a11867a1ab874e324b7c8 Jun 09 13:44:34.806622 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.806601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99b3f8f_55e9_466a_be87_1e46a7723c7c.slice/crio-52e91c09caee5bb116d7ac8241b6382e6c0983e5fce974d219bcbaef2773d384 WatchSource:0}: Error finding container 52e91c09caee5bb116d7ac8241b6382e6c0983e5fce974d219bcbaef2773d384: Status 404 returned error can't find the container with id 52e91c09caee5bb116d7ac8241b6382e6c0983e5fce974d219bcbaef2773d384 Jun 09 13:44:34.808295 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:44:34.808277 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570a7e3d_55be_4402_a77c_faaba0d794a6.slice/crio-4f802f25b6a1aae4cc955fdc49aab51a658a82543f214ceca520b6edb4ea5a47 WatchSource:0}: Error finding container 4f802f25b6a1aae4cc955fdc49aab51a658a82543f214ceca520b6edb4ea5a47: Status 404 returned error can't find the container with id 4f802f25b6a1aae4cc955fdc49aab51a658a82543f214ceca520b6edb4ea5a47 Jun 09 13:44:34.857726 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:34.857706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:34.857835 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.857823 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:34.857880 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.857840 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:34.857880 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.857849 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:34.857940 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:34.857892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:35.857878944 +0000 UTC m=+4.202829258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:35.076218 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.076141 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:39:34 +0000 UTC" deadline="2027-11-13 09:23:52.652757316 +0000 UTC" Jun 09 13:44:35.076218 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.076170 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12523h39m17.576589812s" Jun 09 13:44:35.108858 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.108821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbhph" event={"ID":"ef2585d4-4314-42f1-b86c-c43be883576e","Type":"ContainerStarted","Data":"7998e405ba4cda0a4d5d2c54262b076884b485ea58f0b8616408d3bdaac95c9c"} Jun 09 13:44:35.110003 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.109980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" event={"ID":"302fa1e8-1389-464f-a6ce-2a2e4f8517df","Type":"ContainerStarted","Data":"c1bf8805dbeb112b3434d058c9b0ec5e780f966c9808aaef3f14615cb8a16666"} Jun 09 13:44:35.114495 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.112302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" event={"ID":"7aa2be1dfc9f4320165bfbdb55271e05","Type":"ContainerStarted","Data":"6627ea1da25360591335a86db0a3b6360ca8ab67db93dcdbfa40ef68a3edbf99"} Jun 09 13:44:35.115519 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.115437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"4f802f25b6a1aae4cc955fdc49aab51a658a82543f214ceca520b6edb4ea5a47"} Jun 09 13:44:35.116639 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.116614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" event={"ID":"f99b3f8f-55e9-466a-be87-1e46a7723c7c","Type":"ContainerStarted","Data":"52e91c09caee5bb116d7ac8241b6382e6c0983e5fce974d219bcbaef2773d384"} Jun 09 13:44:35.118058 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.118017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerStarted","Data":"b7eda7ed50512ebf29e3d6b835d637871c3caf53343a11867a1ab874e324b7c8"} Jun 09 13:44:35.119166 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.119147 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cjmwl" event={"ID":"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f","Type":"ContainerStarted","Data":"893aa96a239d7728c8b551e406d9dcff9811431a5983d4fc8831417788e3e6ae"} Jun 09 13:44:35.120319 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.120295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxfdw" event={"ID":"855f1066-4992-41f8-bacc-577dad05f34c","Type":"ContainerStarted","Data":"84a0aab06a5a38512b0bdc1733a47f847cb7c5d069b03b5cd9691131ae17def2"} Jun 09 13:44:35.121513 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.121491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27lnz" event={"ID":"5a70770c-9b14-4b70-bb29-5c7560b6acb3","Type":"ContainerStarted","Data":"88cb4b327383b251a403716db20e00bc272723031000106bdbe5783598f4014a"} Jun 09 13:44:35.123158 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.123131 2578 generic.go:356] "Generic (PLEG): container finished" podID="e1caf063587a22404590bca7c75bcac4" containerID="5063f7adf22e371f31213787b6a39b30c5acbad6c9c76ce00f7177a517c5e5b1" exitCode=0 Jun 09 13:44:35.123241 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.123202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" event={"ID":"e1caf063587a22404590bca7c75bcac4","Type":"ContainerDied","Data":"5063f7adf22e371f31213787b6a39b30c5acbad6c9c76ce00f7177a517c5e5b1"} Jun 09 13:44:35.124423 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.124404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6ghkr" event={"ID":"5cb95f79-c0b7-446e-a06e-7ab515c776d9","Type":"ContainerStarted","Data":"4bf3709e71ade0ca23afbd23f670ac3155c88d53bdf6a87e61403e6ec7a52117"} Jun 09 13:44:35.128864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.128821 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-34.ec2.internal" podStartSLOduration=2.128805969 podStartE2EDuration="2.128805969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:35.128608154 +0000 UTC m=+3.473558492" watchObservedRunningTime="2026-06-09 13:44:35.128805969 +0000 UTC m=+3.473756308" Jun 09 13:44:35.663664 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.663625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:35.663857 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.663818 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:35.663932 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.663881 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:37.663863523 +0000 UTC m=+6.008813844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:35.764837 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.764797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:35.765027 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.764944 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:35.765027 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.765020 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:37.764999809 +0000 UTC m=+6.109950128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:35.865951 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:35.865913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:35.866119 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.866093 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:35.866119 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.866114 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:35.866223 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.866127 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:35.866223 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:35.866185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:37.86616469 +0000 UTC m=+6.211115022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:36.077145 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.077030 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:39:34 +0000 UTC" deadline="2027-11-28 13:33:48.974128744 +0000 UTC" Jun 09 13:44:36.077145 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.077088 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12887h49m12.897044851s" Jun 09 13:44:36.101885 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.101854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:36.102044 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.101999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:36.102044 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:36.102012 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:36.102162 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:36.102140 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:36.102271 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.102216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:36.102326 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:36.102287 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:36.142509 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:36.142375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" event={"ID":"e1caf063587a22404590bca7c75bcac4","Type":"ContainerStarted","Data":"1305c9ea62c4921251111c79d53e629ffb5d605b1021b9104a59ac8d62c4a939"} Jun 09 13:44:37.681866 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:37.681235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:37.681866 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.681425 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:37.681866 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.681509 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:41.681490804 +0000 UTC m=+10.026441147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:37.782168 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:37.782129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:37.782374 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.782338 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:37.782447 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.782402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:41.782384235 +0000 UTC m=+10.127334569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:37.882919 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:37.882872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:37.883103 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.883076 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:37.883103 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.883103 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:37.883213 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.883116 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:37.883213 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:37.883182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:41.88316478 +0000 UTC m=+10.228115098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:38.101613 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:38.101497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:38.101613 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:38.101529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:38.101823 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:38.101630 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:38.101974 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:38.101497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:38.101974 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:38.101967 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:38.102175 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:38.102054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:40.103779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:40.103918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:40.103997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:40.104069 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:40.104135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:40.104516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:40.104206 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:41.717960 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:41.717875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:41.718507 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.717994 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:41.718507 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.718075 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:49.718052962 +0000 UTC m=+18.063003279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:41.818704 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:41.818668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:41.818889 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.818838 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:41.818960 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.818902 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:49.818881678 +0000 UTC m=+18.163831999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:41.919832 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:41.919784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:41.920041 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.919948 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:41.920041 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.919967 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:41.920041 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.919979 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:41.920041 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:41.920039 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:44:49.920021302 +0000 UTC m=+18.264971621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:42.102207 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:42.102138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:42.102352 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:42.102283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:42.103420 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:42.103395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:42.103561 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:42.103501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:42.103561 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:42.103547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:42.103674 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:42.103613 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:44.102213 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:44.101833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:44.102213 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:44.101977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:44.102213 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:44.102163 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:44.102816 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:44.102269 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:44.102816 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:44.102340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:44.102816 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:44.102411 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:46.101518 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:46.101482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:46.101950 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:46.101482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:46.101950 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:46.101619 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:46.101950 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:46.101483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:46.101950 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:46.101697 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:46.101950 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:46.101780 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:48.101179 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:48.101133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:48.101814 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:48.101143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:48.101814 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:48.101278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:48.101814 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:48.101275 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:48.101814 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:48.101383 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:48.101814 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:48.101449 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:49.777227 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:49.777144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:49.777667 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.777312 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:49.777667 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.777381 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:05.777361573 +0000 UTC m=+34.122311904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:44:49.878255 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:49.878222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:49.878418 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.878368 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:49.878459 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.878441 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:05.878422345 +0000 UTC m=+34.223372676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:44:49.979161 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:49.979124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:49.979330 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.979298 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:44:49.979330 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.979321 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:44:49.979330 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.979330 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:49.979488 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:49.979379 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:05.979366152 +0000 UTC m=+34.324316467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:44:50.101796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:50.101552 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:50.101796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:50.101590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:50.101796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:50.101555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:50.101796 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:50.101698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:50.101796 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:50.101777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:50.102130 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:50.101873 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:52.102139 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:52.102102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:52.102617 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:52.102222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:52.102617 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:52.102260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:52.102617 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:52.102217 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:52.102617 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:52.102332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:52.102617 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:52.102406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:54.101613 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.101335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:54.102053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.101335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:54.102053 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:54.101744 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:54.102053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.101385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:54.102053 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:54.101816 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:54.102053 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:54.101846 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:54.185070 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.184907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6ghkr" event={"ID":"5cb95f79-c0b7-446e-a06e-7ab515c776d9","Type":"ContainerStarted","Data":"7cf5bf93fd23efefd938d3239624f233d222adc4e82b8a8ff9cc64d7f081c583"} Jun 09 13:44:54.186237 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.186212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbhph" event={"ID":"ef2585d4-4314-42f1-b86c-c43be883576e","Type":"ContainerStarted","Data":"b709e4419b1f735b29dd1d3b6f42e5e939d9c2b352df1b1e4fbef903f15f67c8"} Jun 09 13:44:54.187519 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.187492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" event={"ID":"302fa1e8-1389-464f-a6ce-2a2e4f8517df","Type":"ContainerStarted","Data":"11cff5590cb1d890519f27e8b9048069c76cf33b00d296ee85e0f7c1ec35c0cc"} Jun 09 13:44:54.189203 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.189187 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:44:54.189527 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.189509 2578 generic.go:356] "Generic (PLEG): container finished" podID="570a7e3d-55be-4402-a77c-faaba0d794a6" containerID="7fa2f1596773a785af1bfe5eac0ec3e8da81072d575eb3b7d3a3b08b1e056471" exitCode=1 Jun 09 13:44:54.189609 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.189581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"ef31d37664b22af2e3c69b1bee31c3fbb82c2cf294ca6687af179fc6f3eb203a"} Jun 09 13:44:54.189669 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.189655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerDied","Data":"7fa2f1596773a785af1bfe5eac0ec3e8da81072d575eb3b7d3a3b08b1e056471"} Jun 09 13:44:54.189725 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.189708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"5f4b8632623f176fe6e08e54cad86d367bf46543adb0a9ae93951b611199f415"} Jun 09 13:44:54.190804 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.190779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" event={"ID":"f99b3f8f-55e9-466a-be87-1e46a7723c7c","Type":"ContainerStarted","Data":"6d8912e40aafef5a9588574320b5120812866e83d95b88313b0b98350fb99ccc"} Jun 09 13:44:54.192136 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.192113 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="b9fb3feb6ce8af776738ad15d1b57c997436ced89c4f601014bf52c9947a3835" exitCode=0 Jun 09 13:44:54.192226 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.192209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"b9fb3feb6ce8af776738ad15d1b57c997436ced89c4f601014bf52c9947a3835"} Jun 09 13:44:54.193742 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.193704 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gxfdw" event={"ID":"855f1066-4992-41f8-bacc-577dad05f34c","Type":"ContainerStarted","Data":"1364c4af0ff6eaed8bbd9a69f223d4df022aa44e6c9a63fd2444526309dc939d"} Jun 09 13:44:54.195293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.195249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27lnz" event={"ID":"5a70770c-9b14-4b70-bb29-5c7560b6acb3","Type":"ContainerStarted","Data":"80b538bed3e57d56602293d5fc40e4aa30be8b90f8765fb3ae82eb4fa5e752db"} Jun 09 13:44:54.202196 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.202144 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6ghkr" podStartSLOduration=3.383886963 podStartE2EDuration="22.202132235s" totalImagesPullingTime="18.818245272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:54.201784271 +0000 UTC m=+22.546734608" watchObservedRunningTime="2026-06-09 13:44:54.202132235 +0000 UTC m=+22.547082571" Jun 09 13:44:54.202558 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.202534 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-34.ec2.internal" podStartSLOduration=21.202528835 podStartE2EDuration="21.202528835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:36.157805603 +0000 UTC m=+4.502755967" watchObservedRunningTime="2026-06-09 13:44:54.202528835 +0000 UTC m=+22.547479172" Jun 09 13:44:54.219346 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.219311 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f5pqj" podStartSLOduration=3.408230132 podStartE2EDuration="22.219299917s" totalImagesPullingTime="18.811069785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:54.218884923 +0000 UTC m=+22.563835260" watchObservedRunningTime="2026-06-09 13:44:54.219299917 +0000 UTC m=+22.564250268" Jun 09 13:44:54.232998 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.232941 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gxfdw" podStartSLOduration=3.462350162 podStartE2EDuration="22.232922305s" totalImagesPullingTime="18.770572143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:54.232376935 +0000 UTC m=+22.577327271" watchObservedRunningTime="2026-06-09 13:44:54.232922305 +0000 UTC m=+22.577872641" Jun 09 13:44:54.284782 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.284738 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-27lnz" podStartSLOduration=3.3961629 podStartE2EDuration="22.284723043s" totalImagesPullingTime="18.888560143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:54.284181491 +0000 UTC m=+22.629131853" watchObservedRunningTime="2026-06-09 13:44:54.284723043 +0000 UTC m=+22.629673378" Jun 09 13:44:54.302923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:54.302885 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbhph" podStartSLOduration=3.5388372219999997 podStartE2EDuration="22.302865427s" totalImagesPullingTime="18.764028205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:54.302586814 +0000 UTC m=+22.647537152" watchObservedRunningTime="2026-06-09 13:44:54.302865427 +0000 UTC m=+22.647815763" Jun 09 13:44:55.199665 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.199593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cjmwl" event={"ID":"1aabe04b-fdf9-4a44-b1db-7dfcde35be6f","Type":"ContainerStarted","Data":"f5b1f00a423dfeed596cfb59b2bfaf0deab0aad183a343f4ef78248ff7aac81b"} Jun 09 13:44:55.202810 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.202786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:44:55.203244 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.203212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"7024985485ae46e7b07b68dc828c85874f8bd336a457e54e9233f23683008459"} Jun 09 13:44:55.203340 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.203301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"7d096b974425edeb94fef6e16b3d08a790da220b9d85fbc1ac94e5cd4c3a7b4f"} Jun 09 13:44:55.203405 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.203347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"b018cf61a52c13c28f8b1bfad81a9e81e62428ee31c8511dd2c90e56947dfeb3"} Jun 09 13:44:55.215237 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.215187 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cjmwl" podStartSLOduration=4.397378077 podStartE2EDuration="23.215168281s" totalImagesPullingTime="18.817790204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:55.21481564 +0000 UTC m=+23.559765978" watchObservedRunningTime="2026-06-09 13:44:55.215168281 +0000 UTC m=+23.560118619" Jun 09 13:44:55.229448 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:55.229422 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 13:44:56.101573 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.101537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:56.101753 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.101537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:56.101753 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:56.101680 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:56.101884 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.101739 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T13:44:55.229444551Z","UUID":"e7dc89fd-5988-4a4a-a5f4-d179a48149aa","Handler":null,"Name":"","Endpoint":""} Jun 09 13:44:56.101884 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:56.101828 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:56.101884 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.101536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:56.102021 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:56.101986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:56.103580 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.103558 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 13:44:56.103701 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.103600 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 13:44:56.207419 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:56.207385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" event={"ID":"302fa1e8-1389-464f-a6ce-2a2e4f8517df","Type":"ContainerStarted","Data":"fce269f863abbc52dedfaf843e3758c212c2b135f6ad7dbf00505b562831fa01"} Jun 09 13:44:57.213192 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:57.212709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" event={"ID":"302fa1e8-1389-464f-a6ce-2a2e4f8517df","Type":"ContainerStarted","Data":"dc8670ffec9098eaa92736b8515d520803bb2c7771108e04bf29af8c7b5b67c0"} Jun 09 13:44:57.216079 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:57.216056 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:44:57.216458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:57.216432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"2ea70c0e02347a847dc59de4ff83dd4467d6bcae13398dd7eaf289a13104d699"} Jun 09 13:44:58.101575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.101290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:44:58.101742 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.101296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:44:58.101742 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:58.101673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:44:58.101834 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:58.101779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:44:58.101834 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.101344 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:44:58.101941 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:44:58.101880 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:44:58.472729 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.472604 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:58.473261 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.473243 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:58.488945 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:58.488890 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gd6pp" podStartSLOduration=5.527138567 podStartE2EDuration="26.488875308s" totalImagesPullingTime="20.961736741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:57.23092495 +0000 UTC m=+25.575875287" watchObservedRunningTime="2026-06-09 13:44:58.488875308 +0000 UTC m=+26.833825688" Jun 09 13:44:59.221833 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.221759 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="e441bb20c330c1719ece350ecdfa282793158c9781e669e2d650356bd80dc343" exitCode=0 Jun 09 13:44:59.221954 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.221852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"e441bb20c330c1719ece350ecdfa282793158c9781e669e2d650356bd80dc343"} Jun 09 13:44:59.225453 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.225436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:44:59.225844 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.225822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"72d562c38f1ea974a11b4007372b86849e877ee4ebc0b35624401e44dd63ad62"} Jun 09 13:44:59.226073 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.226057 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:59.226160 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.226110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:59.226160 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.226141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:59.226249 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.226235 2578 scope.go:117] "RemoveContainer" containerID="7fa2f1596773a785af1bfe5eac0ec3e8da81072d575eb3b7d3a3b08b1e056471" Jun 09 13:44:59.243508 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.243481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:59.243604 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.243592 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:44:59.929147 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.928928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:44:59.930060 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:44:59.930031 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbhph" Jun 09 13:45:00.101865 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.101833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:00.102017 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.101874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:00.102017 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.101832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:00.102017 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.101961 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:45:00.102169 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.102048 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:45:00.102169 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.102128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:45:00.232531 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.232441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:45:00.232893 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.232865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" event={"ID":"570a7e3d-55be-4402-a77c-faaba0d794a6","Type":"ContainerStarted","Data":"e1f5e09e9625bf614ac22712b2c04a96d6d2e0fbb31794d39243cb1b3e3861d7"} Jun 09 13:45:00.235121 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.235090 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="78b0c971df86078fd21c648782be863e7511e51a161d0a815b96c70f51da7987" exitCode=0 Jun 09 13:45:00.235253 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.235167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"78b0c971df86078fd21c648782be863e7511e51a161d0a815b96c70f51da7987"} Jun 09 13:45:00.259667 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.259626 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" podStartSLOduration=9.41570369 podStartE2EDuration="28.25961002s" totalImagesPullingTime="18.84390633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:00.258016795 +0000 UTC m=+28.602967153" watchObservedRunningTime="2026-06-09 13:45:00.25961002 +0000 UTC m=+28.604560396" Jun 09 13:45:00.559057 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.559021 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7npwn"] Jun 09 13:45:00.559210 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.559135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:00.559256 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.559237 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:45:00.562118 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.562092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lmfv"] Jun 09 13:45:00.562214 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.562174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:00.562273 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.562260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:45:00.565343 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.565320 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qhgg"] Jun 09 13:45:00.565431 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:00.565389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:00.565498 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:00.565457 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:45:01.242550 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:01.242519 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="8ae79b06771ed033a5514bfdb9c2d4b46f2351535af42eb4e95736e625f7cca5" exitCode=0 Jun 09 13:45:01.243260 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:01.242613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"8ae79b06771ed033a5514bfdb9c2d4b46f2351535af42eb4e95736e625f7cca5"} Jun 09 13:45:02.102022 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:02.101989 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:02.102207 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:02.102028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:02.102207 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:02.102098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:02.102207 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:02.102121 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:45:02.102207 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:02.102168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:45:02.102405 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:02.102251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:45:04.102053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:04.102001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:04.102053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:04.102053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:04.102779 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:04.102150 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:45:04.102779 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:04.102194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:04.102779 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:04.102273 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:45:04.102779 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:04.102350 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:45:05.792644 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:05.792605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:05.793137 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.792760 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:05.793137 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.792821 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret podName:c3e7cb8e-453b-4142-9626-66cdd842f114 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:37.792804047 +0000 UTC m=+66.137754379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret") pod "global-pull-secret-syncer-7npwn" (UID: "c3e7cb8e-453b-4142-9626-66cdd842f114") : object "kube-system"/"original-pull-secret" not registered Jun 09 13:45:05.893635 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:05.893608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:05.893801 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.893766 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:05.893847 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.893834 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:37.893815533 +0000 UTC m=+66.238765849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 13:45:05.994877 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:05.994846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:05.995079 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.994985 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 13:45:05.995079 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.995006 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 13:45:05.995079 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.995018 2578 projected.go:196] Error preparing data for projected volume kube-api-access-qhn2x for pod openshift-network-diagnostics/network-check-target-7lmfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:05.995079 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:05.995079 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x podName:53e3e626-0b73-4dc3-a273-6bd0aa6d00d2 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:37.995060227 +0000 UTC m=+66.340010542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhn2x" (UniqueName: "kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x") pod "network-check-target-7lmfv" (UID: "53e3e626-0b73-4dc3-a273-6bd0aa6d00d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 13:45:06.101717 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.101646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:06.101883 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.101646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:06.101883 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.101748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:45:06.101883 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.101657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:06.101883 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.101813 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lmfv" podUID="53e3e626-0b73-4dc3-a273-6bd0aa6d00d2" Jun 09 13:45:06.101883 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.101874 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7npwn" podUID="c3e7cb8e-453b-4142-9626-66cdd842f114" Jun 09 13:45:06.256684 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.256648 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="e4db7cad563b6c35fd28429953e3279adf3e3ecb6c449aea9e001d8cfe0fa90e" exitCode=0 Jun 09 13:45:06.256972 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.256696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"e4db7cad563b6c35fd28429953e3279adf3e3ecb6c449aea9e001d8cfe0fa90e"} Jun 09 13:45:06.503120 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.503094 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-34.ec2.internal" event="NodeReady" Jun 09 13:45:06.503281 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.503210 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 13:45:06.543996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.543969 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f"] Jun 09 13:45:06.550989 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.550967 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8"] Jun 09 13:45:06.551102 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.551086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.554721 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.554695 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 13:45:06.554841 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.554740 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 13:45:06.554841 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.554704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 13:45:06.556203 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.556167 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 13:45:06.556203 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.556180 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 13:45:06.556351 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.556174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 13:45:06.556351 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.556262 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 13:45:06.563098 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.563077 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:45:06.563233 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.563214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.566503 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.566484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 13:45:06.568180 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.568164 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xrl59\"" Jun 09 13:45:06.575233 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.575213 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7"] Jun 09 13:45:06.575392 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.575338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.578152 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.578134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 13:45:06.578243 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.578161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 13:45:06.578389 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.578372 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 13:45:06.578443 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.578427 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hrcxt\"" Jun 09 13:45:06.585812 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.585789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 13:45:06.587645 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.587624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bfj82"] Jun 09 13:45:06.587792 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.587775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.590143 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.590127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 13:45:06.597512 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.597495 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f"] Jun 09 13:45:06.597591 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.597523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8"] Jun 09 13:45:06.597591 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.597535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7"] Jun 09 13:45:06.597591 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.597535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.597591 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.597550 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b6qmn"] Jun 09 13:45:06.601166 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.601145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 13:45:06.601166 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.601159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 13:45:06.601287 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.601235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7smxg\"" Jun 09 13:45:06.607129 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.607088 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:45:06.607129 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.607117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfj82"] Jun 09 13:45:06.607237 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.607133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b6qmn"] Jun 09 13:45:06.607237 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.607193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.610050 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.610008 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 13:45:06.610304 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.610287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 13:45:06.610425 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.610408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 13:45:06.610887 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.610715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d6s2d\"" Jun 09 13:45:06.699631 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.699631 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/85603104-5654-47e9-9d9f-e3c62ba33e1f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.699864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b321942-1772-456f-8759-ece9eff2ce78-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.699864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.699864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.699864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b321942-1772-456f-8759-ece9eff2ce78-tmp\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.699864 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49vc\" (UniqueName: \"kubernetes.io/projected/4b92f701-6168-4d1c-8e3a-cf488ab79e65-kube-api-access-k49vc\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.699977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d48601b-fc2a-4136-bac3-567b23abf91a-cert\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.700055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvqn\" (UniqueName: \"kubernetes.io/projected/cbed5b72-1743-4901-b9c8-a051638b4433-kube-api-access-zqvqn\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stgpc\" (UniqueName: \"kubernetes.io/projected/85603104-5654-47e9-9d9f-e3c62ba33e1f-kube-api-access-stgpc\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbed5b72-1743-4901-b9c8-a051638b4433-tmp-dir\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbed5b72-1743-4901-b9c8-a051638b4433-config-volume\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b92f701-6168-4d1c-8e3a-cf488ab79e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kffvs\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5ww7\" (UniqueName: \"kubernetes.io/projected/2d48601b-fc2a-4136-bac3-567b23abf91a-kube-api-access-r5ww7\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.700355 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.700306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzfj\" (UniqueName: \"kubernetes.io/projected/6b321942-1772-456f-8759-ece9eff2ce78-kube-api-access-bgzfj\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.801453 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.801453 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b321942-1772-456f-8759-ece9eff2ce78-tmp\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49vc\" (UniqueName: \"kubernetes.io/projected/4b92f701-6168-4d1c-8e3a-cf488ab79e65-kube-api-access-k49vc\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.801922 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b321942-1772-456f-8759-ece9eff2ce78-tmp\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.802219 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.802219 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.801982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d48601b-fc2a-4136-bac3-567b23abf91a-cert\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.802321 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.802234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803442 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803442 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803442 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.803374 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:06.803442 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.803389 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:06.803783 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvqn\" (UniqueName: \"kubernetes.io/projected/cbed5b72-1743-4901-b9c8-a051638b4433-kube-api-access-zqvqn\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.803783 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stgpc\" (UniqueName: \"kubernetes.io/projected/85603104-5654-47e9-9d9f-e3c62ba33e1f-kube-api-access-stgpc\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.803783 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbed5b72-1743-4901-b9c8-a051638b4433-tmp-dir\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbed5b72-1743-4901-b9c8-a051638b4433-config-volume\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b92f701-6168-4d1c-8e3a-cf488ab79e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kffvs\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5ww7\" (UniqueName: \"kubernetes.io/projected/2d48601b-fc2a-4136-bac3-567b23abf91a-kube-api-access-r5ww7\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzfj\" (UniqueName: \"kubernetes.io/projected/6b321942-1772-456f-8759-ece9eff2ce78-kube-api-access-bgzfj\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.803997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.803986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.804072 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.804131 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:07.30411294 +0000 UTC m=+35.649063270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.804281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.804325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/85603104-5654-47e9-9d9f-e3c62ba33e1f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.804356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b321942-1772-456f-8759-ece9eff2ce78-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.804559 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:06.804497 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:07.304477626 +0000 UTC m=+35.649427966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:06.804970 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.804725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbed5b72-1743-4901-b9c8-a051638b4433-tmp-dir\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.804970 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.804962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.805194 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.805173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbed5b72-1743-4901-b9c8-a051638b4433-config-volume\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.805594 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.805565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/85603104-5654-47e9-9d9f-e3c62ba33e1f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.806858 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.806833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.807013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.806966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.807174 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.807152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.807260 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.807242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.807965 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.807931 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-ca\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.808190 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.808167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/85603104-5654-47e9-9d9f-e3c62ba33e1f-hub\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.808263 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.808216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b92f701-6168-4d1c-8e3a-cf488ab79e65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.808376 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.808356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b321942-1772-456f-8759-ece9eff2ce78-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.808450 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.808379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d48601b-fc2a-4136-bac3-567b23abf91a-cert\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.812335 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.812315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.812488 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.812454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49vc\" (UniqueName: \"kubernetes.io/projected/4b92f701-6168-4d1c-8e3a-cf488ab79e65-kube-api-access-k49vc\") pod \"managed-serviceaccount-addon-agent-5767f586d6-sl9f8\" (UID: \"4b92f701-6168-4d1c-8e3a-cf488ab79e65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.815112 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.815067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stgpc\" (UniqueName: \"kubernetes.io/projected/85603104-5654-47e9-9d9f-e3c62ba33e1f-kube-api-access-stgpc\") pod \"cluster-proxy-proxy-agent-64f4df7f55-jtn9f\" (UID: \"85603104-5654-47e9-9d9f-e3c62ba33e1f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.815211 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.815180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvqn\" (UniqueName: \"kubernetes.io/projected/cbed5b72-1743-4901-b9c8-a051638b4433-kube-api-access-zqvqn\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:06.815657 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.815636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzfj\" (UniqueName: \"kubernetes.io/projected/6b321942-1772-456f-8759-ece9eff2ce78-kube-api-access-bgzfj\") pod \"klusterlet-addon-workmgr-6b949b588f-4fcj7\" (UID: \"6b321942-1772-456f-8759-ece9eff2ce78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.815741 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.815687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kffvs\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:06.816254 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.816222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5ww7\" (UniqueName: \"kubernetes.io/projected/2d48601b-fc2a-4136-bac3-567b23abf91a-kube-api-access-r5ww7\") pod \"ingress-canary-b6qmn\" (UID: \"2d48601b-fc2a-4136-bac3-567b23abf91a\") " pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:06.871156 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.871084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:45:06.878222 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.878197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:45:06.899153 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.899127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:06.915511 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:06.915485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b6qmn" Jun 09 13:45:07.050525 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.050165 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f"] Jun 09 13:45:07.064655 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:07.062032 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85603104_5654_47e9_9d9f_e3c62ba33e1f.slice/crio-d7c0062dad13ed2e06a742faa8af0b815aff6bb89df39d9f9cbc4512c560ad39 WatchSource:0}: Error finding container d7c0062dad13ed2e06a742faa8af0b815aff6bb89df39d9f9cbc4512c560ad39: Status 404 returned error can't find the container with id d7c0062dad13ed2e06a742faa8af0b815aff6bb89df39d9f9cbc4512c560ad39 Jun 09 13:45:07.134474 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.134398 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7"] Jun 09 13:45:07.137658 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:07.137634 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b321942_1772_456f_8759_ece9eff2ce78.slice/crio-4a755d7abffd366d0692d2d6b6fc5b7666515217aa8ee39324328e6b03559652 WatchSource:0}: Error finding container 4a755d7abffd366d0692d2d6b6fc5b7666515217aa8ee39324328e6b03559652: Status 404 returned error can't find the container with id 4a755d7abffd366d0692d2d6b6fc5b7666515217aa8ee39324328e6b03559652 Jun 09 13:45:07.144425 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.144404 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8"] Jun 09 13:45:07.147075 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.147051 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b6qmn"] Jun 09 13:45:07.147272 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:07.147242 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b92f701_6168_4d1c_8e3a_cf488ab79e65.slice/crio-e7b58a088db3ff0632fad38ea0f2f29a42ef3d610f32265f9344e5e056be6431 WatchSource:0}: Error finding container e7b58a088db3ff0632fad38ea0f2f29a42ef3d610f32265f9344e5e056be6431: Status 404 returned error can't find the container with id e7b58a088db3ff0632fad38ea0f2f29a42ef3d610f32265f9344e5e056be6431 Jun 09 13:45:07.149874 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:07.149851 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d48601b_fc2a_4136_bac3_567b23abf91a.slice/crio-1067d640e96bff5f728dca635160cd4cc2bc6aa571014185143da894ee6c8ae6 WatchSource:0}: Error finding container 1067d640e96bff5f728dca635160cd4cc2bc6aa571014185143da894ee6c8ae6: Status 404 returned error can't find the container with id 1067d640e96bff5f728dca635160cd4cc2bc6aa571014185143da894ee6c8ae6 Jun 09 13:45:07.262793 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.262765 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b940780-c069-4d8d-ab26-ec35a783971d" containerID="5d42432ce7597254c94d10c05df24007c2ba2ac1016f6f33cc0faef38bcb3f6b" exitCode=0 Jun 09 13:45:07.262947 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.262842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerDied","Data":"5d42432ce7597254c94d10c05df24007c2ba2ac1016f6f33cc0faef38bcb3f6b"} Jun 09 13:45:07.264023 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.263991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerStarted","Data":"4a755d7abffd366d0692d2d6b6fc5b7666515217aa8ee39324328e6b03559652"} Jun 09 13:45:07.265047 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.265023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b6qmn" event={"ID":"2d48601b-fc2a-4136-bac3-567b23abf91a","Type":"ContainerStarted","Data":"1067d640e96bff5f728dca635160cd4cc2bc6aa571014185143da894ee6c8ae6"} Jun 09 13:45:07.266027 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.266009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerStarted","Data":"e7b58a088db3ff0632fad38ea0f2f29a42ef3d610f32265f9344e5e056be6431"} Jun 09 13:45:07.267071 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.267050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerStarted","Data":"d7c0062dad13ed2e06a742faa8af0b815aff6bb89df39d9f9cbc4512c560ad39"} Jun 09 13:45:07.308608 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.308577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:07.308726 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:07.308674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:07.308776 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:07.308749 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:07.308776 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:07.308771 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:07.308876 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:07.308794 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:07.308876 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:07.308835 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:08.308813941 +0000 UTC m=+36.653764258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:07.308876 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:07.308848 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:08.30884258 +0000 UTC m=+36.653792894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:08.103490 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.102233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:08.103490 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.103129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:08.103490 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.103274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:08.105859 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.105837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:45:08.111732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.109889 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:45:08.111732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.109961 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htm2v\"" Jun 09 13:45:08.111732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.110298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:45:08.111732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.110413 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:45:08.111732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.110640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4kfs\"" Jun 09 13:45:08.281589 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.281554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dwrml" event={"ID":"5b940780-c069-4d8d-ab26-ec35a783971d","Type":"ContainerStarted","Data":"5c376d8651504b473c7f56db36730ee3f98adf91afe94e8231361c58740695ae"} Jun 09 13:45:08.336227 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.336185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:08.336412 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:08.336283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:08.336516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:08.336415 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:08.336516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:08.336431 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:08.336516 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:08.336513 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:10.336491995 +0000 UTC m=+38.681442324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:08.337033 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:08.336982 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:08.337167 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:08.337039 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:10.337024482 +0000 UTC m=+38.681974815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:10.357102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:10.357216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:10.357264 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:10.357342 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:14.357320836 +0000 UTC m=+42.702271151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:10.357353 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:10.357368 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:10.357445 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:10.357419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:14.357403673 +0000 UTC m=+42.702354011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:14.393263 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:14.392999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:14.393117 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:14.393368 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:14.393426 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:14.393454 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:22.393429542 +0000 UTC m=+50.738379863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:14.393492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:22.393479248 +0000 UTC m=+50.738429576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:14.393799 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:14.393331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:16.306450 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.306408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerStarted","Data":"d8a403cfd669b9d0a9a41268720377715c4fb70f3bd7a691f089cf0d2a59eea5"} Jun 09 13:45:16.308524 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.308497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerStarted","Data":"63b1c34b799bb969194b0a81721801c9f51217fd0a519e6e0c9091c2bf5bfc29"} Jun 09 13:45:16.308655 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.308534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerStarted","Data":"ca94616161a9f8e0fdb520f01371f88b5fd1134f0a8ede8ec784fe9ab53aed65"} Jun 09 13:45:16.308655 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.308545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerStarted","Data":"77046046a0a61317fff4c098ba4d6c755bf913bee4322c5c0779000721789d72"} Jun 09 13:45:16.309840 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.309819 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerStarted","Data":"a2137a836501a10cacc49211666ee81d5622d1f5e6c232d5541b49a42f158e58"} Jun 09 13:45:16.309975 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.309957 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:16.311310 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.311285 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b6qmn" event={"ID":"2d48601b-fc2a-4136-bac3-567b23abf91a","Type":"ContainerStarted","Data":"59a577d445095aa1e78054c0d0523d18eb1ddb1725553c4a13bcc5fed9550cec"} Jun 09 13:45:16.311831 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.311815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:45:16.324012 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.323962 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dwrml" podStartSLOduration=15.180657992 podStartE2EDuration="44.323935628s" totalImagesPullingTime="29.143277636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:08.306150754 +0000 UTC m=+36.651101089" watchObservedRunningTime="2026-06-09 13:45:16.323935628 +0000 UTC m=+44.668885959" Jun 09 13:45:16.324746 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.324718 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" podStartSLOduration=20.072645793 podStartE2EDuration="28.324705885s" totalImagesPullingTime="8.252060092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:16.32292443 +0000 UTC m=+44.667874767" watchObservedRunningTime="2026-06-09 13:45:16.324705885 +0000 UTC m=+44.669656222" Jun 09 13:45:16.340511 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.340451 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" podStartSLOduration=20.07852275 podStartE2EDuration="28.340440213s" totalImagesPullingTime="8.261917463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:16.339635892 +0000 UTC m=+44.684586240" watchObservedRunningTime="2026-06-09 13:45:16.340440213 +0000 UTC m=+44.685390550" Jun 09 13:45:16.356690 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.356653 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b6qmn" podStartSLOduration=2.10661369 podStartE2EDuration="10.356640822s" totalImagesPullingTime="8.250027132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:16.356133895 +0000 UTC m=+44.701084243" watchObservedRunningTime="2026-06-09 13:45:16.356640822 +0000 UTC m=+44.701591159" Jun 09 13:45:16.373509 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:16.373454 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" podStartSLOduration=20.021751543 podStartE2EDuration="28.373441347s" totalImagesPullingTime="8.351689804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:16.372994321 +0000 UTC m=+44.717944663" watchObservedRunningTime="2026-06-09 13:45:16.373441347 +0000 UTC m=+44.718391684" Jun 09 13:45:22.450067 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:22.450021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:22.450103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:22.450159 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:22.450183 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:22.450221 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:22.450249 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:38.450230946 +0000 UTC m=+66.795181279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:22.450432 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:22.450265 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:45:38.450254234 +0000 UTC m=+66.795204549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:31.253092 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:31.253063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ff8g" Jun 09 13:45:37.871775 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:37.871732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:37.874354 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:37.874336 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 13:45:37.885305 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:37.885281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3e7cb8e-453b-4142-9626-66cdd842f114-original-pull-secret\") pod \"global-pull-secret-syncer-7npwn\" (UID: \"c3e7cb8e-453b-4142-9626-66cdd842f114\") " pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:37.972770 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:37.972734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:45:37.975564 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:37.975541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 13:45:37.983779 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:37.983763 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:45:37.983884 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:37.983844 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:46:41.983822728 +0000 UTC m=+130.328773044 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : secret "metrics-daemon-secret" not found Jun 09 13:45:38.073694 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.073660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:38.076458 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.076440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 13:45:38.087509 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.087492 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 13:45:38.098107 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.098080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhn2x\" (UniqueName: \"kubernetes.io/projected/53e3e626-0b73-4dc3-a273-6bd0aa6d00d2-kube-api-access-qhn2x\") pod \"network-check-target-7lmfv\" (UID: \"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2\") " pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:38.139148 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.139079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7npwn" Jun 09 13:45:38.155737 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.155714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4kfs\"" Jun 09 13:45:38.163009 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.162990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:38.300828 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.300795 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7npwn"] Jun 09 13:45:38.303685 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:38.303659 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e7cb8e_453b_4142_9626_66cdd842f114.slice/crio-dd2a214d8e0ea9dd5d858c03954c8d060a75b1caef31f8fa7871a37b9c56ab49 WatchSource:0}: Error finding container dd2a214d8e0ea9dd5d858c03954c8d060a75b1caef31f8fa7871a37b9c56ab49: Status 404 returned error can't find the container with id dd2a214d8e0ea9dd5d858c03954c8d060a75b1caef31f8fa7871a37b9c56ab49 Jun 09 13:45:38.322482 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.322443 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lmfv"] Jun 09 13:45:38.325635 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:45:38.325606 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e3e626_0b73_4dc3_a273_6bd0aa6d00d2.slice/crio-3bb28117a91ee96cb2b5b61507a1deca88cc43b1a5522ced859b2c6e7e4951c4 WatchSource:0}: Error finding container 3bb28117a91ee96cb2b5b61507a1deca88cc43b1a5522ced859b2c6e7e4951c4: Status 404 returned error can't find the container with id 3bb28117a91ee96cb2b5b61507a1deca88cc43b1a5522ced859b2c6e7e4951c4 Jun 09 13:45:38.375886 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.375855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7npwn" event={"ID":"c3e7cb8e-453b-4142-9626-66cdd842f114","Type":"ContainerStarted","Data":"dd2a214d8e0ea9dd5d858c03954c8d060a75b1caef31f8fa7871a37b9c56ab49"} Jun 09 13:45:38.376934 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.376900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lmfv" event={"ID":"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2","Type":"ContainerStarted","Data":"3bb28117a91ee96cb2b5b61507a1deca88cc43b1a5522ced859b2c6e7e4951c4"} Jun 09 13:45:38.475966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.475874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:45:38.475966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:38.475950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:45:38.476161 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:38.476036 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:45:38.476161 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:38.476054 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:45:38.476161 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:38.476073 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:45:38.476161 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:38.476109 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:46:10.476091542 +0000 UTC m=+98.821041861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:45:38.476161 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:45:38.476124 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:46:10.476118224 +0000 UTC m=+98.821068539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:45:41.388722 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:41.388684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lmfv" event={"ID":"53e3e626-0b73-4dc3-a273-6bd0aa6d00d2","Type":"ContainerStarted","Data":"4e5af001cc254b9f2f2aa71eac95b81b0e23214cea9af6c34b27e523d84af484"} Jun 09 13:45:41.389105 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:41.388837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:45:41.406700 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:41.406651 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7lmfv" podStartSLOduration=66.487977482 podStartE2EDuration="1m9.406637762s" totalImagesPullingTime="2.91866028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:41.405017884 +0000 UTC m=+69.749968234" watchObservedRunningTime="2026-06-09 13:45:41.406637762 +0000 UTC m=+69.751588095" Jun 09 13:45:43.395963 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:43.395929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7npwn" event={"ID":"c3e7cb8e-453b-4142-9626-66cdd842f114","Type":"ContainerStarted","Data":"1ccd658298e2885f6800d7b37c37d7216859bc2ff31ec5db66189cf311d93049"} Jun 09 13:45:43.412230 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:45:43.412107 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7npwn" podStartSLOduration=66.427648487 podStartE2EDuration="1m11.412073286s" totalImagesPullingTime="4.984424799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:45:43.411141648 +0000 UTC m=+71.756091987" watchObservedRunningTime="2026-06-09 13:45:43.412073286 +0000 UTC m=+71.757023622" Jun 09 13:46:10.511652 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:46:10.511609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:46:10.511684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:10.511756 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:10.511785 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:10.511796 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:10.511822 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:47:14.511804781 +0000 UTC m=+162.856755099 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:46:10.512072 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:10.511846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:47:14.511833518 +0000 UTC m=+162.856783837 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:46:12.394720 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:46:12.394686 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7lmfv" Jun 09 13:46:42.033168 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:46:42.033130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:46:42.033683 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:42.033305 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 13:46:42.033683 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:46:42.033398 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs podName:37ce0a49-a45f-4d83-b916-a7db6704ca11 nodeName:}" failed. No retries permitted until 2026-06-09 13:48:44.03338168 +0000 UTC m=+252.378331995 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs") pod "network-metrics-daemon-8qhgg" (UID: "37ce0a49-a45f-4d83-b916-a7db6704ca11") : secret "metrics-daemon-secret" not found Jun 09 13:47:09.593688 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:09.593635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" Jun 09 13:47:09.605855 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:09.605813 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bfj82" podUID="cbed5b72-1743-4901-b9c8-a051638b4433" Jun 09 13:47:09.641351 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:09.641323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:47:09.641456 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:09.641323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfj82" Jun 09 13:47:11.129952 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:11.129888 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8qhgg" podUID="37ce0a49-a45f-4d83-b916-a7db6704ca11" Jun 09 13:47:14.576201 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:14.576116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:47:14.576201 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:14.576180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:47:14.576633 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:14.576274 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 13:47:14.576633 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:14.576327 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls podName:cbed5b72-1743-4901-b9c8-a051638b4433 nodeName:}" failed. No retries permitted until 2026-06-09 13:49:16.576312958 +0000 UTC m=+284.921263274 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls") pod "dns-default-bfj82" (UID: "cbed5b72-1743-4901-b9c8-a051638b4433") : secret "dns-default-metrics-tls" not found Jun 09 13:47:14.576633 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:14.576278 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 13:47:14.576633 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:14.576368 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb: secret "image-registry-tls" not found Jun 09 13:47:14.576633 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:47:14.576407 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls podName:4447d7c0-2239-4a1a-a148-e9acc5348048 nodeName:}" failed. No retries permitted until 2026-06-09 13:49:16.576396068 +0000 UTC m=+284.921346396 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls") pod "image-registry-7bfc7fc4b6-kz6qb" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048") : secret "image-registry-tls" not found Jun 09 13:47:15.659873 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.659839 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b92f701-6168-4d1c-8e3a-cf488ab79e65" containerID="d8a403cfd669b9d0a9a41268720377715c4fb70f3bd7a691f089cf0d2a59eea5" exitCode=255 Jun 09 13:47:15.660273 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.659918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerDied","Data":"d8a403cfd669b9d0a9a41268720377715c4fb70f3bd7a691f089cf0d2a59eea5"} Jun 09 13:47:15.660273 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.660236 2578 scope.go:117] "RemoveContainer" containerID="d8a403cfd669b9d0a9a41268720377715c4fb70f3bd7a691f089cf0d2a59eea5" Jun 09 13:47:15.661500 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.661448 2578 generic.go:356] "Generic (PLEG): container finished" podID="6b321942-1772-456f-8759-ece9eff2ce78" containerID="a2137a836501a10cacc49211666ee81d5622d1f5e6c232d5541b49a42f158e58" exitCode=1 Jun 09 13:47:15.661604 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.661520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerDied","Data":"a2137a836501a10cacc49211666ee81d5622d1f5e6c232d5541b49a42f158e58"} Jun 09 13:47:15.661792 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:15.661775 2578 scope.go:117] "RemoveContainer" containerID="a2137a836501a10cacc49211666ee81d5622d1f5e6c232d5541b49a42f158e58" Jun 09 13:47:16.310773 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:16.310737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:47:16.665747 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:16.665661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerStarted","Data":"81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe"} Jun 09 13:47:16.667228 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:16.667206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerStarted","Data":"c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed"} Jun 09 13:47:16.667392 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:16.667382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:47:16.667944 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:16.667927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:47:24.101221 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:47:24.101179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:48:20.145719 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:20.145692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6ghkr_5cb95f79-c0b7-446e-a06e-7ab515c776d9/dns-node-resolver/0.log" Jun 09 13:48:21.544982 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:21.544949 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxfdw_855f1066-4992-41f8-bacc-577dad05f34c/node-ca/0.log" Jun 09 13:48:22.344260 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:22.344232 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b6qmn_2d48601b-fc2a-4136-bac3-567b23abf91a/serve-healthcheck-canary/0.log" Jun 09 13:48:42.148135 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.148103 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wlf6x"] Jun 09 13:48:42.150054 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.150037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.152528 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.152508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 13:48:42.152652 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.152508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 13:48:42.152652 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.152558 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 13:48:42.153582 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.153565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 13:48:42.153639 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.153632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2cw7\"" Jun 09 13:48:42.161714 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.161693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlf6x"] Jun 09 13:48:42.296923 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.296898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.297100 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.296929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaf97b45-23bf-411f-9bbf-54954bd746f5-data-volume\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.297100 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.296965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aaf97b45-23bf-411f-9bbf-54954bd746f5-crio-socket\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.297100 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.297052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7h5\" (UniqueName: \"kubernetes.io/projected/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-api-access-ms7h5\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.297206 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.297125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aaf97b45-23bf-411f-9bbf-54954bd746f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.397758 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaf97b45-23bf-411f-9bbf-54954bd746f5-data-volume\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.397895 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aaf97b45-23bf-411f-9bbf-54954bd746f5-crio-socket\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.397895 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7h5\" (UniqueName: \"kubernetes.io/projected/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-api-access-ms7h5\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.397895 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aaf97b45-23bf-411f-9bbf-54954bd746f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.398042 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aaf97b45-23bf-411f-9bbf-54954bd746f5-crio-socket\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.398042 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.397916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.398173 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.398075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaf97b45-23bf-411f-9bbf-54954bd746f5-data-volume\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.398452 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.398436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.400174 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.400154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aaf97b45-23bf-411f-9bbf-54954bd746f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.405290 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.405268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7h5\" (UniqueName: \"kubernetes.io/projected/aaf97b45-23bf-411f-9bbf-54954bd746f5-kube-api-access-ms7h5\") pod \"insights-runtime-extractor-wlf6x\" (UID: \"aaf97b45-23bf-411f-9bbf-54954bd746f5\") " pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.459231 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.459209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlf6x" Jun 09 13:48:42.583602 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.583569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlf6x"] Jun 09 13:48:42.586608 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:48:42.586584 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf97b45_23bf_411f_9bbf_54954bd746f5.slice/crio-c4b156d3b0fca158997c10419ea428a91ef596692a68ef47cbd78a9c70cddea6 WatchSource:0}: Error finding container c4b156d3b0fca158997c10419ea428a91ef596692a68ef47cbd78a9c70cddea6: Status 404 returned error can't find the container with id c4b156d3b0fca158997c10419ea428a91ef596692a68ef47cbd78a9c70cddea6 Jun 09 13:48:42.909394 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.909360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlf6x" event={"ID":"aaf97b45-23bf-411f-9bbf-54954bd746f5","Type":"ContainerStarted","Data":"4f7fbaeaaaa9f26220536c2aab74ad812a1db41c612086f6876e77f69eeaf6f8"} Jun 09 13:48:42.909578 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:42.909418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlf6x" event={"ID":"aaf97b45-23bf-411f-9bbf-54954bd746f5","Type":"ContainerStarted","Data":"c4b156d3b0fca158997c10419ea428a91ef596692a68ef47cbd78a9c70cddea6"} Jun 09 13:48:43.914534 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:43.914496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlf6x" event={"ID":"aaf97b45-23bf-411f-9bbf-54954bd746f5","Type":"ContainerStarted","Data":"ffe7aa30940f23b8a09e9f1829917b5479b1fad19919ad4324b65c17988d8e29"} Jun 09 13:48:44.110226 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.110196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:48:44.112911 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.112890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37ce0a49-a45f-4d83-b916-a7db6704ca11-metrics-certs\") pod \"network-metrics-daemon-8qhgg\" (UID: \"37ce0a49-a45f-4d83-b916-a7db6704ca11\") " pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:48:44.204741 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.204670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htm2v\"" Jun 09 13:48:44.212737 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.212708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qhgg" Jun 09 13:48:44.346178 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.346142 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qhgg"] Jun 09 13:48:44.735342 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:48:44.735308 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ce0a49_a45f_4d83_b916_a7db6704ca11.slice/crio-49415e98612e5740c48c09eaef716e060c5ff9a1eeb927d045e0e0e45e944ab0 WatchSource:0}: Error finding container 49415e98612e5740c48c09eaef716e060c5ff9a1eeb927d045e0e0e45e944ab0: Status 404 returned error can't find the container with id 49415e98612e5740c48c09eaef716e060c5ff9a1eeb927d045e0e0e45e944ab0 Jun 09 13:48:44.919674 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.919630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlf6x" event={"ID":"aaf97b45-23bf-411f-9bbf-54954bd746f5","Type":"ContainerStarted","Data":"6a4a6292f1a69e32240b04d693b04191c4948d6ede934fee848ee80ce2149f37"} Jun 09 13:48:44.920730 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.920709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qhgg" event={"ID":"37ce0a49-a45f-4d83-b916-a7db6704ca11","Type":"ContainerStarted","Data":"49415e98612e5740c48c09eaef716e060c5ff9a1eeb927d045e0e0e45e944ab0"} Jun 09 13:48:44.938283 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:44.938243 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wlf6x" podStartSLOduration=0.870245432 podStartE2EDuration="2.938230278s" totalImagesPullingTime="2.067984846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:48:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:44.938102745 +0000 UTC m=+253.283053082" watchObservedRunningTime="2026-06-09 13:48:44.938230278 +0000 UTC m=+253.283180614" Jun 09 13:48:45.925860 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:45.925822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qhgg" event={"ID":"37ce0a49-a45f-4d83-b916-a7db6704ca11","Type":"ContainerStarted","Data":"b6f7f0a885d2360e7ed903a33af8f52a975c477b1db4e77807533994b714ff1b"} Jun 09 13:48:45.926224 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:45.925904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qhgg" event={"ID":"37ce0a49-a45f-4d83-b916-a7db6704ca11","Type":"ContainerStarted","Data":"600eec4b76bddf3334f2ecc0b3736e80896d2e6347f1b3641d14ac53006961c0"} Jun 09 13:48:45.943356 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:45.943311 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8qhgg" podStartSLOduration=253.201408745 podStartE2EDuration="4m13.943297356s" totalImagesPullingTime="741.888611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:45.942867048 +0000 UTC m=+254.287817414" watchObservedRunningTime="2026-06-09 13:48:45.943297356 +0000 UTC m=+254.288247692" Jun 09 13:48:56.641168 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.641135 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dgssx"] Jun 09 13:48:56.643247 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.643225 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.645884 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.645860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 13:48:56.646139 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.646121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 13:48:56.646244 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.646183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 13:48:56.646961 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.646945 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 13:48:56.646961 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.646960 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 13:48:56.647115 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.647043 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 13:48:56.647115 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.647057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hndwj\"" Jun 09 13:48:56.802368 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-root\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802533 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802533 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802533 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-textfile\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802641 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-wtmp\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802641 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802641 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf5ll\" (UniqueName: \"kubernetes.io/projected/b237148a-e32f-4d4d-8baf-004eaa85f98a-kube-api-access-xf5ll\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-sys\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.802733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.802682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-metrics-client-ca\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.872394 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.872354 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" podUID="85603104-5654-47e9-9d9f-e3c62ba33e1f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 13:48:56.903440 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903440 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-textfile\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903440 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-wtmp\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf5ll\" (UniqueName: \"kubernetes.io/projected/b237148a-e32f-4d4d-8baf-004eaa85f98a-kube-api-access-xf5ll\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-sys\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-metrics-client-ca\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:48:56.903592 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-wtmp\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-root\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:48:56.903654 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls podName:b237148a-e32f-4d4d-8baf-004eaa85f98a nodeName:}" failed. No retries permitted until 2026-06-09 13:48:57.403633882 +0000 UTC m=+265.748584211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls") pod "node-exporter-dgssx" (UID: "b237148a-e32f-4d4d-8baf-004eaa85f98a") : secret "node-exporter-tls" not found Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-sys\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.903696 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903681 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b237148a-e32f-4d4d-8baf-004eaa85f98a-root\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.904137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.904137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.903788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-textfile\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.904137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.904075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-metrics-client-ca\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.904137 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.904118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.905937 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.905917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:56.915522 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:56.915500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf5ll\" (UniqueName: \"kubernetes.io/projected/b237148a-e32f-4d4d-8baf-004eaa85f98a-kube-api-access-xf5ll\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:57.408637 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:57.408600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:57.410927 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:57.410898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b237148a-e32f-4d4d-8baf-004eaa85f98a-node-exporter-tls\") pod \"node-exporter-dgssx\" (UID: \"b237148a-e32f-4d4d-8baf-004eaa85f98a\") " pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:57.552117 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:57.552087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgssx" Jun 09 13:48:57.561219 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:48:57.561194 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb237148a_e32f_4d4d_8baf_004eaa85f98a.slice/crio-4ad9716daa1ebc3771e8da7dff0644665377f15963c298c4e118a8c950066a41 WatchSource:0}: Error finding container 4ad9716daa1ebc3771e8da7dff0644665377f15963c298c4e118a8c950066a41: Status 404 returned error can't find the container with id 4ad9716daa1ebc3771e8da7dff0644665377f15963c298c4e118a8c950066a41 Jun 09 13:48:57.964936 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:57.964896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgssx" event={"ID":"b237148a-e32f-4d4d-8baf-004eaa85f98a","Type":"ContainerStarted","Data":"4ad9716daa1ebc3771e8da7dff0644665377f15963c298c4e118a8c950066a41"} Jun 09 13:48:58.969661 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:58.969573 2578 generic.go:356] "Generic (PLEG): container finished" podID="b237148a-e32f-4d4d-8baf-004eaa85f98a" containerID="7f23bddb086e13f6c16fda0475a156053789d4f8d5bd510387e20d4807655896" exitCode=0 Jun 09 13:48:58.969661 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:58.969615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgssx" event={"ID":"b237148a-e32f-4d4d-8baf-004eaa85f98a","Type":"ContainerDied","Data":"7f23bddb086e13f6c16fda0475a156053789d4f8d5bd510387e20d4807655896"} Jun 09 13:48:59.975160 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:59.975125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgssx" event={"ID":"b237148a-e32f-4d4d-8baf-004eaa85f98a","Type":"ContainerStarted","Data":"ab17df077c482dc41d44329b81fe88e7515563dda585dbd9e66e3e25712bf02e"} Jun 09 13:48:59.975592 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:59.975176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgssx" event={"ID":"b237148a-e32f-4d4d-8baf-004eaa85f98a","Type":"ContainerStarted","Data":"9c382b87ee3f9cbf8dbc49d40c3ec28b696b852fed3acc26979c7df4b54deda7"} Jun 09 13:48:59.995190 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:48:59.995139 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dgssx" podStartSLOduration=2.964247002 podStartE2EDuration="3.995122074s" totalImagesPullingTime="967.851156ms" totalInitContainerRuntime="63.023916ms" isStatefulPod=true podCreationTimestamp="2026-06-09 13:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:48:59.993816481 +0000 UTC m=+268.338766838" watchObservedRunningTime="2026-06-09 13:48:59.995122074 +0000 UTC m=+268.340072410" Jun 09 13:49:06.872584 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:06.872531 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" podUID="85603104-5654-47e9-9d9f-e3c62ba33e1f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 13:49:12.642755 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:12.642712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" Jun 09 13:49:12.642755 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:12.642710 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bfj82" podUID="cbed5b72-1743-4901-b9c8-a051638b4433" Jun 09 13:49:13.013595 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:13.013559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:13.013757 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:13.013560 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:16.025238 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.025205 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b92f701-6168-4d1c-8e3a-cf488ab79e65" containerID="81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe" exitCode=255 Jun 09 13:49:16.025671 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.025279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerDied","Data":"81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe"} Jun 09 13:49:16.025671 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.025333 2578 scope.go:117] "RemoveContainer" containerID="d8a403cfd669b9d0a9a41268720377715c4fb70f3bd7a691f089cf0d2a59eea5" Jun 09 13:49:16.025671 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.025645 2578 scope.go:117] "RemoveContainer" containerID="81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe" Jun 09 13:49:16.025836 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:16.025817 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5767f586d6-sl9f8_open-cluster-management-agent-addon(4b92f701-6168-4d1c-8e3a-cf488ab79e65)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" podUID="4b92f701-6168-4d1c-8e3a-cf488ab79e65" Jun 09 13:49:16.026996 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.026973 2578 generic.go:356] "Generic (PLEG): container finished" podID="6b321942-1772-456f-8759-ece9eff2ce78" containerID="c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed" exitCode=1 Jun 09 13:49:16.027070 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.027021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerDied","Data":"c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed"} Jun 09 13:49:16.027270 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.027258 2578 scope.go:117] "RemoveContainer" containerID="c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed" Jun 09 13:49:16.027397 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:16.027384 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b949b588f-4fcj7_open-cluster-management-agent-addon(6b321942-1772-456f-8759-ece9eff2ce78)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" podUID="6b321942-1772-456f-8759-ece9eff2ce78" Jun 09 13:49:16.035441 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.035424 2578 scope.go:117] "RemoveContainer" containerID="a2137a836501a10cacc49211666ee81d5622d1f5e6c232d5541b49a42f158e58" Jun 09 13:49:16.650670 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.650642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:16.650839 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.650679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:16.653006 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.652988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbed5b72-1743-4901-b9c8-a051638b4433-metrics-tls\") pod \"dns-default-bfj82\" (UID: \"cbed5b72-1743-4901-b9c8-a051638b4433\") " pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:16.653086 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.653064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"image-registry-7bfc7fc4b6-kz6qb\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:16.667928 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.667899 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:49:16.873212 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.873179 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" podUID="85603104-5654-47e9-9d9f-e3c62ba33e1f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 13:49:16.873381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.873251 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" Jun 09 13:49:16.873762 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.873732 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"63b1c34b799bb969194b0a81721801c9f51217fd0a519e6e0c9091c2bf5bfc29"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 13:49:16.873844 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.873781 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" podUID="85603104-5654-47e9-9d9f-e3c62ba33e1f" containerName="service-proxy" containerID="cri-o://63b1c34b799bb969194b0a81721801c9f51217fd0a519e6e0c9091c2bf5bfc29" gracePeriod=30 Jun 09 13:49:16.878555 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.878275 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" Jun 09 13:49:16.900055 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.900035 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:49:16.918007 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.917946 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7smxg\"" Jun 09 13:49:16.918007 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.917952 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hrcxt\"" Jun 09 13:49:16.925030 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.925011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:16.925127 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:16.925112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:17.033753 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.033730 2578 scope.go:117] "RemoveContainer" containerID="81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe" Jun 09 13:49:17.034079 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:17.034041 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5767f586d6-sl9f8_open-cluster-management-agent-addon(4b92f701-6168-4d1c-8e3a-cf488ab79e65)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" podUID="4b92f701-6168-4d1c-8e3a-cf488ab79e65" Jun 09 13:49:17.036117 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.036004 2578 generic.go:356] "Generic (PLEG): container finished" podID="85603104-5654-47e9-9d9f-e3c62ba33e1f" containerID="63b1c34b799bb969194b0a81721801c9f51217fd0a519e6e0c9091c2bf5bfc29" exitCode=2 Jun 09 13:49:17.036117 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.036065 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerDied","Data":"63b1c34b799bb969194b0a81721801c9f51217fd0a519e6e0c9091c2bf5bfc29"} Jun 09 13:49:17.038717 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.038292 2578 scope.go:117] "RemoveContainer" containerID="c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed" Jun 09 13:49:17.038717 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:17.038476 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b949b588f-4fcj7_open-cluster-management-agent-addon(6b321942-1772-456f-8759-ece9eff2ce78)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" podUID="6b321942-1772-456f-8759-ece9eff2ce78" Jun 09 13:49:17.069042 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.069017 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfj82"] Jun 09 13:49:17.072347 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:49:17.072313 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbed5b72_1743_4901_b9c8_a051638b4433.slice/crio-f1b0f78ad875e6c51ea537e2c4ac907ee83a5370215898fb5766fa49b5fa9d99 WatchSource:0}: Error finding container f1b0f78ad875e6c51ea537e2c4ac907ee83a5370215898fb5766fa49b5fa9d99: Status 404 returned error can't find the container with id f1b0f78ad875e6c51ea537e2c4ac907ee83a5370215898fb5766fa49b5fa9d99 Jun 09 13:49:17.087994 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:17.087938 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:49:18.042844 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.042811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" event={"ID":"4447d7c0-2239-4a1a-a148-e9acc5348048","Type":"ContainerStarted","Data":"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b"} Jun 09 13:49:18.043393 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.042865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" event={"ID":"4447d7c0-2239-4a1a-a148-e9acc5348048","Type":"ContainerStarted","Data":"201245dc0857f7684170776749f5a7cbf0e2ebfd0b9b40248d163895cc247e6b"} Jun 09 13:49:18.043393 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.042889 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:18.043997 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.043974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfj82" event={"ID":"cbed5b72-1743-4901-b9c8-a051638b4433","Type":"ContainerStarted","Data":"f1b0f78ad875e6c51ea537e2c4ac907ee83a5370215898fb5766fa49b5fa9d99"} Jun 09 13:49:18.046684 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.046659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f4df7f55-jtn9f" event={"ID":"85603104-5654-47e9-9d9f-e3c62ba33e1f","Type":"ContainerStarted","Data":"af976fb04f7d0dc0a1f6e3a84b15cae137be2fc98ee3fbdf71995187d7a565cb"} Jun 09 13:49:18.047110 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.047093 2578 scope.go:117] "RemoveContainer" containerID="c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed" Jun 09 13:49:18.047248 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:49:18.047230 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b949b588f-4fcj7_open-cluster-management-agent-addon(6b321942-1772-456f-8759-ece9eff2ce78)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" podUID="6b321942-1772-456f-8759-ece9eff2ce78" Jun 09 13:49:18.062796 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:18.062751 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" podStartSLOduration=264.062737518 podStartE2EDuration="4m24.062737518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:18.061164248 +0000 UTC m=+286.406114589" watchObservedRunningTime="2026-06-09 13:49:18.062737518 +0000 UTC m=+286.407687855" Jun 09 13:49:19.052160 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:19.052124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfj82" event={"ID":"cbed5b72-1743-4901-b9c8-a051638b4433","Type":"ContainerStarted","Data":"516272f130f207ec22eb57c5d93690bfc1764b1142726f35e32ae0ac254ec1e2"} Jun 09 13:49:19.052537 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:19.052178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfj82" event={"ID":"cbed5b72-1743-4901-b9c8-a051638b4433","Type":"ContainerStarted","Data":"8d6fc3a6adf66f145824c0f025fc2cefcce4ab034b7c0e2104784cb4f63b0664"} Jun 09 13:49:19.052537 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:19.052439 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:19.070993 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:19.070952 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bfj82" podStartSLOduration=251.609904873 podStartE2EDuration="4m13.070938301s" totalImagesPullingTime="1.461033428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:49:19.069729135 +0000 UTC m=+287.414679511" watchObservedRunningTime="2026-06-09 13:49:19.070938301 +0000 UTC m=+287.415888638" Jun 09 13:49:29.058423 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:29.058393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bfj82" Jun 09 13:49:30.101768 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:30.101735 2578 scope.go:117] "RemoveContainer" containerID="81757736207fb1eab22af354dd80ffe386b419adb201487abd192662a44adbbe" Jun 09 13:49:31.094553 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:31.094518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5767f586d6-sl9f8" event={"ID":"4b92f701-6168-4d1c-8e3a-cf488ab79e65","Type":"ContainerStarted","Data":"ce4f7711360e899e34394719483e7a02353271702cfb019c3b9fd70be73cec36"} Jun 09 13:49:31.101212 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:31.101190 2578 scope.go:117] "RemoveContainer" containerID="c86ae3639a89b9f32c0972907dcdd35a1a1b2168e658c5b10e2f31f64d3db3ed" Jun 09 13:49:32.044279 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.044246 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:49:32.047363 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.047344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:49:32.052732 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.052714 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 13:49:32.099287 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.099114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" event={"ID":"6b321942-1772-456f-8759-ece9eff2ce78","Type":"ContainerStarted","Data":"0bc4def6aab8767580fd44524cf6e53ca7c33d81a36d95eb916fd451435cd800"} Jun 09 13:49:32.113567 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.099456 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:49:32.113567 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:32.102307 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b949b588f-4fcj7" Jun 09 13:49:36.929236 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:36.929194 2578 patch_prober.go:28] interesting pod/image-registry-7bfc7fc4b6-kz6qb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 13:49:36.929637 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:36.929258 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:49:39.056452 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:39.056425 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:49:42.517246 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:42.517211 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:49:44.201416 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:44.201387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfj82_cbed5b72-1743-4901-b9c8-a051638b4433/dns/0.log" Jun 09 13:49:44.401856 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:44.401825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfj82_cbed5b72-1743-4901-b9c8-a051638b4433/kube-rbac-proxy/0.log" Jun 09 13:49:45.401806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:45.401772 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6ghkr_5cb95f79-c0b7-446e-a06e-7ab515c776d9/dns-node-resolver/0.log" Jun 09 13:49:46.601929 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:49:46.601897 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b6qmn_2d48601b-fc2a-4136-bac3-567b23abf91a/serve-healthcheck-canary/0.log" Jun 09 13:50:07.536161 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:07.536093 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerName="registry" containerID="cri-o://f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b" gracePeriod=30 Jun 09 13:50:08.782740 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.782717 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:50:08.898724 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898634 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898724 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898679 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898724 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898703 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898734 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kffvs\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898774 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898853 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.898990 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.898881 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration\") pod \"4447d7c0-2239-4a1a-a148-e9acc5348048\" (UID: \"4447d7c0-2239-4a1a-a148-e9acc5348048\") " Jun 09 13:50:08.899234 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.899081 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:08.899234 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.899191 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:50:08.901348 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.901313 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:08.901608 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.901583 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:08.901705 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.901660 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs" (OuterVolumeSpecName: "kube-api-access-kffvs") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "kube-api-access-kffvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:08.901774 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.901750 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:50:08.901814 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.901764 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 13:50:08.909596 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.909566 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4447d7c0-2239-4a1a-a148-e9acc5348048" (UID: "4447d7c0-2239-4a1a-a148-e9acc5348048"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:50:08.999575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999531 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-installation-pull-secrets\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999570 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-bound-sa-token\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999579 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4447d7c0-2239-4a1a-a148-e9acc5348048-ca-trust-extracted\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999575 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999590 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4447d7c0-2239-4a1a-a148-e9acc5348048-image-registry-private-configuration\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999600 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-certificates\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999608 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-registry-tls\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999622 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4447d7c0-2239-4a1a-a148-e9acc5348048-trusted-ca\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:08.999806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:08.999630 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kffvs\" (UniqueName: \"kubernetes.io/projected/4447d7c0-2239-4a1a-a148-e9acc5348048-kube-api-access-kffvs\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:50:09.225579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.225502 2578 generic.go:356] "Generic (PLEG): container finished" podID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerID="f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b" exitCode=0 Jun 09 13:50:09.225579 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.225565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" event={"ID":"4447d7c0-2239-4a1a-a148-e9acc5348048","Type":"ContainerDied","Data":"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b"} Jun 09 13:50:09.225733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.225600 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" Jun 09 13:50:09.225733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.225614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb" event={"ID":"4447d7c0-2239-4a1a-a148-e9acc5348048","Type":"ContainerDied","Data":"201245dc0857f7684170776749f5a7cbf0e2ebfd0b9b40248d163895cc247e6b"} Jun 09 13:50:09.225733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.225643 2578 scope.go:117] "RemoveContainer" containerID="f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b" Jun 09 13:50:09.234869 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.234850 2578 scope.go:117] "RemoveContainer" containerID="f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b" Jun 09 13:50:09.235160 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:50:09.235138 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b\": container with ID starting with f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b not found: ID does not exist" containerID="f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b" Jun 09 13:50:09.235227 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.235167 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b"} err="failed to get container status \"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b\": rpc error: code = NotFound desc = could not find container \"f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b\": container with ID starting with f1d501d1063f894307e8c3f8c206c7d06a263bbf826e19cb4815472e404e9b5b not found: ID does not exist" Jun 09 13:50:09.248185 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.248157 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:50:09.252789 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:09.252769 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bfc7fc4b6-kz6qb"] Jun 09 13:50:10.105306 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:50:10.105277 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" path="/var/lib/kubelet/pods/4447d7c0-2239-4a1a-a148-e9acc5348048/volumes" Jun 09 13:54:32.065813 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:54:32.065784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:54:32.066761 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:54:32.066741 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:55:13.882503 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.882453 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z"] Jun 09 13:55:13.885050 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.882724 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerName="registry" Jun 09 13:55:13.885050 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.882735 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerName="registry" Jun 09 13:55:13.885050 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.882776 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4447d7c0-2239-4a1a-a148-e9acc5348048" containerName="registry" Jun 09 13:55:13.886080 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.886065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:13.890210 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.890183 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 13:55:13.890340 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.890183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4v8wk\"" Jun 09 13:55:13.891148 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.891127 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 13:55:13.904075 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.904046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z"] Jun 09 13:55:13.993177 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.993141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxf4w\" (UniqueName: \"kubernetes.io/projected/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-kube-api-access-wxf4w\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:13.993327 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:13.993216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.094074 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.094041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.094227 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.094089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxf4w\" (UniqueName: \"kubernetes.io/projected/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-kube-api-access-wxf4w\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.094418 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.094397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.103361 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.103335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxf4w\" (UniqueName: \"kubernetes.io/projected/6ae9d0d4-6faf-4cf1-9804-1356513e8ee6-kube-api-access-wxf4w\") pod \"openshift-lws-operator-fd8ccff4c-mzv5z\" (UID: \"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.194484 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.194391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" Jun 09 13:55:14.316035 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.316001 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z"] Jun 09 13:55:14.319102 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:55:14.319076 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ae9d0d4_6faf_4cf1_9804_1356513e8ee6.slice/crio-c5d25d87851f9224d9dcb03cdb4416c5fda82b8f8af0c5f1e7ea056c06af1b7f WatchSource:0}: Error finding container c5d25d87851f9224d9dcb03cdb4416c5fda82b8f8af0c5f1e7ea056c06af1b7f: Status 404 returned error can't find the container with id c5d25d87851f9224d9dcb03cdb4416c5fda82b8f8af0c5f1e7ea056c06af1b7f Jun 09 13:55:14.320737 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:14.320716 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 13:55:15.190971 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:15.190934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" event={"ID":"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6","Type":"ContainerStarted","Data":"c5d25d87851f9224d9dcb03cdb4416c5fda82b8f8af0c5f1e7ea056c06af1b7f"} Jun 09 13:55:17.200452 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:17.200425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" event={"ID":"6ae9d0d4-6faf-4cf1-9804-1356513e8ee6","Type":"ContainerStarted","Data":"426a7fa384b1bd202733c88847cc19892a100ee8302f6116d795aabf59cb94c8"} Jun 09 13:55:17.217254 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:17.217199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzv5z" podStartSLOduration=1.4004956659999999 podStartE2EDuration="4.21718212s" totalImagesPullingTime="2.816686454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:17.215948031 +0000 UTC m=+645.560898369" watchObservedRunningTime="2026-06-09 13:55:17.21718212 +0000 UTC m=+645.562132457" Jun 09 13:55:34.270842 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.270806 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd"] Jun 09 13:55:34.277382 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.277365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.280311 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.280289 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 13:55:34.280618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.280602 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 13:55:34.280711 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.280627 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 13:55:34.280841 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.280828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 13:55:34.281312 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.281292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m2hn6\"" Jun 09 13:55:34.292946 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.292919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd"] Jun 09 13:55:34.444663 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.444631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.444824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.444675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.444824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.444698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.444824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.444749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2pc\" (UniqueName: \"kubernetes.io/projected/d5976b5b-7246-40f1-912f-053525781881-kube-api-access-jr2pc\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.444824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.444782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546183 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2pc\" (UniqueName: \"kubernetes.io/projected/d5976b5b-7246-40f1-912f-053525781881-kube-api-access-jr2pc\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546183 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546183 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546404 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546404 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.546625 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.546587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-manifests\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.548611 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.548581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5976b5b-7246-40f1-912f-053525781881-tmp\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.548708 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.548610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.548708 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.548683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5976b5b-7246-40f1-912f-053525781881-webhook-cert\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.556150 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.556131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2pc\" (UniqueName: \"kubernetes.io/projected/d5976b5b-7246-40f1-912f-053525781881-kube-api-access-jr2pc\") pod \"opendatahub-operator-controller-manager-7877c79489-zjpbd\" (UID: \"d5976b5b-7246-40f1-912f-053525781881\") " pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.587031 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.587007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:34.753445 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:34.753418 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd"] Jun 09 13:55:34.756001 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:55:34.755965 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5976b5b_7246_40f1_912f_053525781881.slice/crio-72d9f2191583bd21a925c8381654369d650dac76875e6a5b813ebf859686ac9e WatchSource:0}: Error finding container 72d9f2191583bd21a925c8381654369d650dac76875e6a5b813ebf859686ac9e: Status 404 returned error can't find the container with id 72d9f2191583bd21a925c8381654369d650dac76875e6a5b813ebf859686ac9e Jun 09 13:55:35.263406 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:35.263366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" event={"ID":"d5976b5b-7246-40f1-912f-053525781881","Type":"ContainerStarted","Data":"72d9f2191583bd21a925c8381654369d650dac76875e6a5b813ebf859686ac9e"} Jun 09 13:55:38.276643 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:38.276601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" event={"ID":"d5976b5b-7246-40f1-912f-053525781881","Type":"ContainerStarted","Data":"670c3db62f754a9c02a5d6e1c54b8c72ddddaf1b2b5241b56f55333050190e1c"} Jun 09 13:55:39.281981 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:39.281947 2578 generic.go:356] "Generic (PLEG): container finished" podID="d5976b5b-7246-40f1-912f-053525781881" containerID="670c3db62f754a9c02a5d6e1c54b8c72ddddaf1b2b5241b56f55333050190e1c" exitCode=0 Jun 09 13:55:39.282398 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:39.282038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" event={"ID":"d5976b5b-7246-40f1-912f-053525781881","Type":"ContainerDied","Data":"670c3db62f754a9c02a5d6e1c54b8c72ddddaf1b2b5241b56f55333050190e1c"} Jun 09 13:55:40.287252 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:40.287190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" event={"ID":"d5976b5b-7246-40f1-912f-053525781881","Type":"ContainerStarted","Data":"fe2f03932e9e99050fa5e0a255a5e3450ee23df3b39b43b90404a134ee7fb3a7"} Jun 09 13:55:40.287656 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:40.287307 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:40.310807 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:40.310762 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" podStartSLOduration=2.0643090219999998 podStartE2EDuration="6.310747292s" totalImagesPullingTime="3.270914691s" totalInitContainerRuntime="975.523579ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:55:40.309628114 +0000 UTC m=+668.654578490" watchObservedRunningTime="2026-06-09 13:55:40.310747292 +0000 UTC m=+668.655697628" Jun 09 13:55:51.292514 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:51.292455 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7877c79489-zjpbd" Jun 09 13:55:54.213292 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.213256 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kd5dr"] Jun 09 13:55:54.216392 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.216373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.220156 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.220138 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 13:55:54.220371 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.220358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lbzsd\"" Jun 09 13:55:54.249185 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.249158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kd5dr"] Jun 09 13:55:54.267733 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.267703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.267857 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.267747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94lqc\" (UniqueName: \"kubernetes.io/projected/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-kube-api-access-94lqc\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.368874 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.368829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.369056 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.368889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94lqc\" (UniqueName: \"kubernetes.io/projected/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-kube-api-access-94lqc\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.369056 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:55:54.368974 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 13:55:54.369056 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:55:54.369037 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert podName:959e6c1a-ddfa-4ed8-83f0-829c0f03bab2 nodeName:}" failed. No retries permitted until 2026-06-09 13:55:54.869021072 +0000 UTC m=+683.213971386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert") pod "odh-model-controller-6dc94f689f-kd5dr" (UID: "959e6c1a-ddfa-4ed8-83f0-829c0f03bab2") : secret "odh-model-controller-webhook-cert" not found Jun 09 13:55:54.384309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.384280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94lqc\" (UniqueName: \"kubernetes.io/projected/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-kube-api-access-94lqc\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.873497 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.873444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:54.875949 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:54.875915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959e6c1a-ddfa-4ed8-83f0-829c0f03bab2-cert\") pod \"odh-model-controller-6dc94f689f-kd5dr\" (UID: \"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2\") " pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:55.126976 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.126883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:55:55.135765 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.135737 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dpkpd"] Jun 09 13:55:55.147886 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.147858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.151622 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.151598 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 13:55:55.151956 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.151605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-v8r5b\"" Jun 09 13:55:55.164120 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.164092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dpkpd"] Jun 09 13:55:55.176881 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.176849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.177013 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.176886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxf2\" (UniqueName: \"kubernetes.io/projected/3208bc74-ba6c-4d6e-b190-474e354d1b96-kube-api-access-ccxf2\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.277598 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.277561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.278064 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.277609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxf2\" (UniqueName: \"kubernetes.io/projected/3208bc74-ba6c-4d6e-b190-474e354d1b96-kube-api-access-ccxf2\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.278064 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:55:55.277776 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 13:55:55.278064 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:55:55.277850 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs podName:3208bc74-ba6c-4d6e-b190-474e354d1b96 nodeName:}" failed. No retries permitted until 2026-06-09 13:55:55.777827029 +0000 UTC m=+684.122777344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs") pod "model-serving-api-5dd488fc48-dpkpd" (UID: "3208bc74-ba6c-4d6e-b190-474e354d1b96") : secret "model-serving-api-tls" not found Jun 09 13:55:55.278926 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.278902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kd5dr"] Jun 09 13:55:55.281982 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:55:55.281955 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959e6c1a_ddfa_4ed8_83f0_829c0f03bab2.slice/crio-730bd4c34478980c57f2b35494397123e8325ef8703c86f53be365e98c28af79 WatchSource:0}: Error finding container 730bd4c34478980c57f2b35494397123e8325ef8703c86f53be365e98c28af79: Status 404 returned error can't find the container with id 730bd4c34478980c57f2b35494397123e8325ef8703c86f53be365e98c28af79 Jun 09 13:55:55.287760 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.287742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxf2\" (UniqueName: \"kubernetes.io/projected/3208bc74-ba6c-4d6e-b190-474e354d1b96-kube-api-access-ccxf2\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.340968 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.340932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" event={"ID":"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2","Type":"ContainerStarted","Data":"730bd4c34478980c57f2b35494397123e8325ef8703c86f53be365e98c28af79"} Jun 09 13:55:55.782019 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.781980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:55.784453 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:55.784413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3208bc74-ba6c-4d6e-b190-474e354d1b96-tls-certs\") pod \"model-serving-api-5dd488fc48-dpkpd\" (UID: \"3208bc74-ba6c-4d6e-b190-474e354d1b96\") " pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:56.059737 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:56.059654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:55:56.205552 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:56.205481 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dpkpd"] Jun 09 13:55:56.208295 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:55:56.208264 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3208bc74_ba6c_4d6e_b190_474e354d1b96.slice/crio-d6a9419135f8edb2bbcc012fd7599fa7aedc199535221de03890f61a1c11b932 WatchSource:0}: Error finding container d6a9419135f8edb2bbcc012fd7599fa7aedc199535221de03890f61a1c11b932: Status 404 returned error can't find the container with id d6a9419135f8edb2bbcc012fd7599fa7aedc199535221de03890f61a1c11b932 Jun 09 13:55:56.346272 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:56.346179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" event={"ID":"3208bc74-ba6c-4d6e-b190-474e354d1b96","Type":"ContainerStarted","Data":"d6a9419135f8edb2bbcc012fd7599fa7aedc199535221de03890f61a1c11b932"} Jun 09 13:55:59.377511 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.377478 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9"] Jun 09 13:55:59.381870 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.381851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.384939 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.384917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 13:55:59.385200 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.385178 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 13:55:59.385276 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.385247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 13:55:59.386082 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.386032 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 13:55:59.386082 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.386057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jtrsc\"" Jun 09 13:55:59.399871 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.399846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9"] Jun 09 13:55:59.408756 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.408731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a9212a-91af-42eb-9ec2-28e017d6a681-tmp\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.408876 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.408771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4q8\" (UniqueName: \"kubernetes.io/projected/86a9212a-91af-42eb-9ec2-28e017d6a681-kube-api-access-9x4q8\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.408876 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.408864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a9212a-91af-42eb-9ec2-28e017d6a681-tls-certs\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.509723 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.509687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4q8\" (UniqueName: \"kubernetes.io/projected/86a9212a-91af-42eb-9ec2-28e017d6a681-kube-api-access-9x4q8\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.509966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.509773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a9212a-91af-42eb-9ec2-28e017d6a681-tls-certs\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.509966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.509805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a9212a-91af-42eb-9ec2-28e017d6a681-tmp\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.512158 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.512132 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a9212a-91af-42eb-9ec2-28e017d6a681-tmp\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.512382 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.512350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a9212a-91af-42eb-9ec2-28e017d6a681-tls-certs\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.518583 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.518556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4q8\" (UniqueName: \"kubernetes.io/projected/86a9212a-91af-42eb-9ec2-28e017d6a681-kube-api-access-9x4q8\") pod \"kube-auth-proxy-586f49fcfd-gmpr9\" (UID: \"86a9212a-91af-42eb-9ec2-28e017d6a681\") " pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.694121 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.694100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" Jun 09 13:55:59.848739 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:55:59.848706 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9"] Jun 09 13:55:59.852286 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:55:59.852256 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a9212a_91af_42eb_9ec2_28e017d6a681.slice/crio-19d4f8e09f048b50eb5d10b0fe32b3e19400361669bc5556839a16210b6898d1 WatchSource:0}: Error finding container 19d4f8e09f048b50eb5d10b0fe32b3e19400361669bc5556839a16210b6898d1: Status 404 returned error can't find the container with id 19d4f8e09f048b50eb5d10b0fe32b3e19400361669bc5556839a16210b6898d1 Jun 09 13:56:00.364971 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.364933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" event={"ID":"86a9212a-91af-42eb-9ec2-28e017d6a681","Type":"ContainerStarted","Data":"19d4f8e09f048b50eb5d10b0fe32b3e19400361669bc5556839a16210b6898d1"} Jun 09 13:56:00.366525 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.366491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" event={"ID":"3208bc74-ba6c-4d6e-b190-474e354d1b96","Type":"ContainerStarted","Data":"a7aafd187ae1d896e5c71aa9879c11ab122f341e31657691cb5b8f0037f8dbb6"} Jun 09 13:56:00.366680 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.366665 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:56:00.368022 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.367995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" event={"ID":"959e6c1a-ddfa-4ed8-83f0-829c0f03bab2","Type":"ContainerStarted","Data":"15451e42896a67b2e6752663d0c0193dd1ab81e5cf08aa14f9b31edd6f3d877c"} Jun 09 13:56:00.368149 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.368133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:56:00.385651 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.385599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" podStartSLOduration=1.894984534 podStartE2EDuration="5.385584539s" totalImagesPullingTime="3.490600005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:00.384952121 +0000 UTC m=+688.729902459" watchObservedRunningTime="2026-06-09 13:56:00.385584539 +0000 UTC m=+688.730534854" Jun 09 13:56:00.401272 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:00.401219 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" podStartSLOduration=2.024128078 podStartE2EDuration="6.401200857s" totalImagesPullingTime="4.377072779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:00.400938907 +0000 UTC m=+688.745889266" watchObservedRunningTime="2026-06-09 13:56:00.401200857 +0000 UTC m=+688.746151196" Jun 09 13:56:03.381679 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:03.381640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" event={"ID":"86a9212a-91af-42eb-9ec2-28e017d6a681","Type":"ContainerStarted","Data":"b537ce1cf8fdffc329061047d3812994067ca171f50bb9b9b8d168322c8d15d4"} Jun 09 13:56:03.449967 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:03.449917 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-586f49fcfd-gmpr9" podStartSLOduration=1.446070036 podStartE2EDuration="4.449901125s" totalImagesPullingTime="3.003831089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:03.447838046 +0000 UTC m=+691.792788383" watchObservedRunningTime="2026-06-09 13:56:03.449901125 +0000 UTC m=+691.794851462" Jun 09 13:56:05.368976 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.368938 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mt7q6"] Jun 09 13:56:05.371632 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.371610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.374203 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.374181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9chzc\"" Jun 09 13:56:05.374293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.374258 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 13:56:05.384375 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.384355 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7"] Jun 09 13:56:05.387224 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.387203 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mt7q6"] Jun 09 13:56:05.387319 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.387260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.390409 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.390386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vxsrv\"" Jun 09 13:56:05.390880 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.390859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 13:56:05.406800 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.406764 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7"] Jun 09 13:56:05.453623 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.453592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb44d70-f49f-4191-a1f1-f20a6d75da29-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.453623 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.453621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9806343-8c3d-444c-91c7-a1f86505e7ad-cert\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.453794 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.453647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p55ht\" (UniqueName: \"kubernetes.io/projected/1fb44d70-f49f-4191-a1f1-f20a6d75da29-kube-api-access-p55ht\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.453794 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.453665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rzp\" (UniqueName: \"kubernetes.io/projected/e9806343-8c3d-444c-91c7-a1f86505e7ad-kube-api-access-z6rzp\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.554438 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.554407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb44d70-f49f-4191-a1f1-f20a6d75da29-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.554438 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.554437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9806343-8c3d-444c-91c7-a1f86505e7ad-cert\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.554629 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.554482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p55ht\" (UniqueName: \"kubernetes.io/projected/1fb44d70-f49f-4191-a1f1-f20a6d75da29-kube-api-access-p55ht\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.554629 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.554502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rzp\" (UniqueName: \"kubernetes.io/projected/e9806343-8c3d-444c-91c7-a1f86505e7ad-kube-api-access-z6rzp\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.556898 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.556873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb44d70-f49f-4191-a1f1-f20a6d75da29-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.557020 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.556974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9806343-8c3d-444c-91c7-a1f86505e7ad-cert\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.570966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.570944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p55ht\" (UniqueName: \"kubernetes.io/projected/1fb44d70-f49f-4191-a1f1-f20a6d75da29-kube-api-access-p55ht\") pod \"llmisvc-controller-manager-864bfd7bc9-4x6n7\" (UID: \"1fb44d70-f49f-4191-a1f1-f20a6d75da29\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.571410 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.571383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rzp\" (UniqueName: \"kubernetes.io/projected/e9806343-8c3d-444c-91c7-a1f86505e7ad-kube-api-access-z6rzp\") pod \"kserve-controller-manager-69fc866d76-mt7q6\" (UID: \"e9806343-8c3d-444c-91c7-a1f86505e7ad\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.681625 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.681537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:05.697644 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.697616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:05.818333 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.818299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mt7q6"] Jun 09 13:56:05.822528 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:56:05.822499 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9806343_8c3d_444c_91c7_a1f86505e7ad.slice/crio-fdba97c26f2f570e84a313ae030eb27aaf6c8d3799ec04c34086453e9faa9a70 WatchSource:0}: Error finding container fdba97c26f2f570e84a313ae030eb27aaf6c8d3799ec04c34086453e9faa9a70: Status 404 returned error can't find the container with id fdba97c26f2f570e84a313ae030eb27aaf6c8d3799ec04c34086453e9faa9a70 Jun 09 13:56:05.858223 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:05.858192 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7"] Jun 09 13:56:05.860603 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:56:05.860577 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1fb44d70_f49f_4191_a1f1_f20a6d75da29.slice/crio-06996dea44f3509a1b5834ec5d09428571f0dd9a37af3694b4593c905709f4ea WatchSource:0}: Error finding container 06996dea44f3509a1b5834ec5d09428571f0dd9a37af3694b4593c905709f4ea: Status 404 returned error can't find the container with id 06996dea44f3509a1b5834ec5d09428571f0dd9a37af3694b4593c905709f4ea Jun 09 13:56:06.399292 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:06.399261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" event={"ID":"1fb44d70-f49f-4191-a1f1-f20a6d75da29","Type":"ContainerStarted","Data":"06996dea44f3509a1b5834ec5d09428571f0dd9a37af3694b4593c905709f4ea"} Jun 09 13:56:06.400381 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:06.400347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" event={"ID":"e9806343-8c3d-444c-91c7-a1f86505e7ad","Type":"ContainerStarted","Data":"fdba97c26f2f570e84a313ae030eb27aaf6c8d3799ec04c34086453e9faa9a70"} Jun 09 13:56:09.416451 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:09.416412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" event={"ID":"e9806343-8c3d-444c-91c7-a1f86505e7ad","Type":"ContainerStarted","Data":"a436bc7b2084456ae31b8127419a83f2c86731eb4b647bf36b4778653440cdd9"} Jun 09 13:56:09.416954 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:09.416551 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:09.437669 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:09.437610 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" podStartSLOduration=1.434038439 podStartE2EDuration="4.437591438s" totalImagesPullingTime="3.003552999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:09.43665066 +0000 UTC m=+697.781600999" watchObservedRunningTime="2026-06-09 13:56:09.437591438 +0000 UTC m=+697.782541782" Jun 09 13:56:10.422181 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:10.422141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" event={"ID":"1fb44d70-f49f-4191-a1f1-f20a6d75da29","Type":"ContainerStarted","Data":"7653f59b86a7bbb9ecb61c670ad32542bc3d7bd966002f7c44b5efb3263055b8"} Jun 09 13:56:10.422663 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:10.422285 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:56:10.441333 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:10.441273 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" podStartSLOduration=1.672532249 podStartE2EDuration="5.441251894s" totalImagesPullingTime="3.768719645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:10.440527145 +0000 UTC m=+698.785477501" watchObservedRunningTime="2026-06-09 13:56:10.441251894 +0000 UTC m=+698.786202232" Jun 09 13:56:11.375738 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:11.375707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-dpkpd" Jun 09 13:56:11.417448 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:11.417417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-kd5dr" Jun 09 13:56:24.111574 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.111539 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dndbr"] Jun 09 13:56:24.114625 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.114603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.118209 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.118191 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 13:56:24.118556 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.118533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 13:56:24.118629 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.118611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6lrwh\"" Jun 09 13:56:24.136269 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.136237 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dndbr"] Jun 09 13:56:24.204094 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.204059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.204262 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.204123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2thl7\" (UniqueName: \"kubernetes.io/projected/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-kube-api-access-2thl7\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.304824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.304792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.304966 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.304856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2thl7\" (UniqueName: \"kubernetes.io/projected/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-kube-api-access-2thl7\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.307300 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.307282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.317402 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.317374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2thl7\" (UniqueName: \"kubernetes.io/projected/07b7f8e1-8701-4f00-8e1e-c07a5cffecfb-kube-api-access-2thl7\") pod \"servicemesh-operator3-57f65f65fb-dndbr\" (UID: \"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.424060 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.423966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:24.570115 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:24.570072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dndbr"] Jun 09 13:56:24.573437 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:56:24.573398 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b7f8e1_8701_4f00_8e1e_c07a5cffecfb.slice/crio-f38d250809a758af1d5ca677dc2eec4f1fccca7c29ee065d76d6e9d955302a49 WatchSource:0}: Error finding container f38d250809a758af1d5ca677dc2eec4f1fccca7c29ee065d76d6e9d955302a49: Status 404 returned error can't find the container with id f38d250809a758af1d5ca677dc2eec4f1fccca7c29ee065d76d6e9d955302a49 Jun 09 13:56:25.505586 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:25.505547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" event={"ID":"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb","Type":"ContainerStarted","Data":"f38d250809a758af1d5ca677dc2eec4f1fccca7c29ee065d76d6e9d955302a49"} Jun 09 13:56:27.518365 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:27.518323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" event={"ID":"07b7f8e1-8701-4f00-8e1e-c07a5cffecfb","Type":"ContainerStarted","Data":"ba80c9ae5cd8db74143b816140b2386af5de483bac4ad2128e081dac3709e941"} Jun 09 13:56:27.518757 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:27.518393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:27.551123 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:27.551075 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" podStartSLOduration=1.109730991 podStartE2EDuration="3.551060027s" totalImagesPullingTime="2.441329036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:27.550529915 +0000 UTC m=+715.895480270" watchObservedRunningTime="2026-06-09 13:56:27.551060027 +0000 UTC m=+715.896010365" Jun 09 13:56:29.722132 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.722094 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt"] Jun 09 13:56:29.784430 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.784393 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt"] Jun 09 13:56:29.784596 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.784570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.787293 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.787268 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rzg4m\"" Jun 09 13:56:29.787447 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.787312 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 13:56:29.851675 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.851641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.851675 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.851680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqnb7\" (UniqueName: \"kubernetes.io/projected/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-kube-api-access-hqnb7\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.952677 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.952634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqnb7\" (UniqueName: \"kubernetes.io/projected/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-kube-api-access-hqnb7\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.952846 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.952733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.953393 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.953374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-redirect-config\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:29.961647 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:29.961612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqnb7\" (UniqueName: \"kubernetes.io/projected/6a5b5742-8e7e-4b8d-a91f-7a05d34e9638-kube-api-access-hqnb7\") pod \"dashboard-redirect-5f4cf5f6dc-vm7mt\" (UID: \"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638\") " pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:30.095607 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:30.095571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" Jun 09 13:56:30.222342 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:30.222313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt"] Jun 09 13:56:30.224743 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:56:30.224711 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5b5742_8e7e_4b8d_a91f_7a05d34e9638.slice/crio-7361c195d0508510d42cd66de9a17907eb36631f5f382394a4b4644f329082d3 WatchSource:0}: Error finding container 7361c195d0508510d42cd66de9a17907eb36631f5f382394a4b4644f329082d3: Status 404 returned error can't find the container with id 7361c195d0508510d42cd66de9a17907eb36631f5f382394a4b4644f329082d3 Jun 09 13:56:30.532705 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:30.532668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" event={"ID":"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638","Type":"ContainerStarted","Data":"7361c195d0508510d42cd66de9a17907eb36631f5f382394a4b4644f329082d3"} Jun 09 13:56:31.376750 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.376720 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r"] Jun 09 13:56:31.379395 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.379377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.384430 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.384410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 13:56:31.384599 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.384579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 13:56:31.385319 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.385302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 13:56:31.385420 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.385335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 13:56:31.394852 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.394824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mqwng\"" Jun 09 13:56:31.411070 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.409027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r"] Jun 09 13:56:31.463442 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a067bdde-8af6-4fd5-ad17-569f02113d1b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463634 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463634 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463634 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463807 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvtq7\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-kube-api-access-fvtq7\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463807 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.463917 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.463811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565004 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.564960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565198 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565995 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvtq7\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-kube-api-access-fvtq7\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565995 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565995 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565995 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a067bdde-8af6-4fd5-ad17-569f02113d1b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.565995 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.565650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.566345 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.566175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.568093 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.568068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.568963 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.568938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.569177 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.569157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a067bdde-8af6-4fd5-ad17-569f02113d1b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.569240 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.569162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.573967 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.573924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvtq7\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-kube-api-access-fvtq7\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.574394 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.574370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a067bdde-8af6-4fd5-ad17-569f02113d1b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5865r\" (UID: \"a067bdde-8af6-4fd5-ad17-569f02113d1b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.689016 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.688933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:31.848336 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:31.848309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r"] Jun 09 13:56:31.851810 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:56:31.851775 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda067bdde_8af6_4fd5_ad17_569f02113d1b.slice/crio-cc70bb7f87e8f284a06bfb6f84062eea61b64874244a4e82e17cfe42bf7a6966 WatchSource:0}: Error finding container cc70bb7f87e8f284a06bfb6f84062eea61b64874244a4e82e17cfe42bf7a6966: Status 404 returned error can't find the container with id cc70bb7f87e8f284a06bfb6f84062eea61b64874244a4e82e17cfe42bf7a6966 Jun 09 13:56:32.543402 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:32.543355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" event={"ID":"a067bdde-8af6-4fd5-ad17-569f02113d1b","Type":"ContainerStarted","Data":"cc70bb7f87e8f284a06bfb6f84062eea61b64874244a4e82e17cfe42bf7a6966"} Jun 09 13:56:33.549660 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:33.549625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" event={"ID":"6a5b5742-8e7e-4b8d-a91f-7a05d34e9638","Type":"ContainerStarted","Data":"67c8de8ab9c64591eb12b79c306d3b0033d492d2193184b26d33a029a4d9accc"} Jun 09 13:56:33.566525 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:33.566407 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5f4cf5f6dc-vm7mt" podStartSLOduration=1.949699509 podStartE2EDuration="4.566390562s" totalImagesPullingTime="2.616691053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:33.56545467 +0000 UTC m=+721.910405013" watchObservedRunningTime="2026-06-09 13:56:33.566390562 +0000 UTC m=+721.911340899" Jun 09 13:56:35.575136 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:35.575096 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 13:56:35.575395 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:35.575165 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 13:56:36.565866 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:36.565825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" event={"ID":"a067bdde-8af6-4fd5-ad17-569f02113d1b","Type":"ContainerStarted","Data":"f9e7574c54243dcce41cbc06a8b4cfa63d0b1d9b03d667ee1a8e4cfe468254ae"} Jun 09 13:56:36.566073 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:36.566036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:36.567942 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:36.567915 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-5865r container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 13:56:36.568060 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:36.567967 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" podUID="a067bdde-8af6-4fd5-ad17-569f02113d1b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 13:56:36.609818 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:36.609754 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" podStartSLOduration=1.8892504479999999 podStartE2EDuration="5.609730416s" totalImagesPullingTime="3.720479968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:56:36.608629509 +0000 UTC m=+724.953579848" watchObservedRunningTime="2026-06-09 13:56:36.609730416 +0000 UTC m=+724.954680755" Jun 09 13:56:37.570890 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:37.570858 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5865r" Jun 09 13:56:38.525546 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:38.525520 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dndbr" Jun 09 13:56:40.427527 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:40.427488 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mt7q6" Jun 09 13:56:41.429057 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:56:41.429025 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4x6n7" Jun 09 13:57:33.824393 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.824355 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j"] Jun 09 13:57:33.827667 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.827647 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:33.830445 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.830424 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 13:57:33.830445 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.830435 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 13:57:33.831550 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.831533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s27ql\"" Jun 09 13:57:33.831609 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.831553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 13:57:33.838576 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.838556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j"] Jun 09 13:57:33.966818 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:33.966782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lpc\" (UniqueName: \"kubernetes.io/projected/892dd560-8708-4e70-8629-075a53c2dd81-kube-api-access-x9lpc\") pod \"dns-operator-controller-manager-864dd78c4c-s2v4j\" (UID: \"892dd560-8708-4e70-8629-075a53c2dd81\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:34.067358 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:34.067323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lpc\" (UniqueName: \"kubernetes.io/projected/892dd560-8708-4e70-8629-075a53c2dd81-kube-api-access-x9lpc\") pod \"dns-operator-controller-manager-864dd78c4c-s2v4j\" (UID: \"892dd560-8708-4e70-8629-075a53c2dd81\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:34.077502 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:34.077413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lpc\" (UniqueName: \"kubernetes.io/projected/892dd560-8708-4e70-8629-075a53c2dd81-kube-api-access-x9lpc\") pod \"dns-operator-controller-manager-864dd78c4c-s2v4j\" (UID: \"892dd560-8708-4e70-8629-075a53c2dd81\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:34.138053 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:34.138025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:34.268519 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:34.268484 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j"] Jun 09 13:57:34.271333 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:57:34.271306 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892dd560_8708_4e70_8629_075a53c2dd81.slice/crio-488c19fa61239b7acab63b88dd1e84200511a9c14910b07a09c9ecbbd4d3d0b2 WatchSource:0}: Error finding container 488c19fa61239b7acab63b88dd1e84200511a9c14910b07a09c9ecbbd4d3d0b2: Status 404 returned error can't find the container with id 488c19fa61239b7acab63b88dd1e84200511a9c14910b07a09c9ecbbd4d3d0b2 Jun 09 13:57:34.818586 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:34.818550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" event={"ID":"892dd560-8708-4e70-8629-075a53c2dd81","Type":"ContainerStarted","Data":"488c19fa61239b7acab63b88dd1e84200511a9c14910b07a09c9ecbbd4d3d0b2"} Jun 09 13:57:36.830058 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:36.830027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" event={"ID":"892dd560-8708-4e70-8629-075a53c2dd81","Type":"ContainerStarted","Data":"92bea50a5a86686b0c84cac3a6965877a657a63556cecd8776b6c9e27520c03f"} Jun 09 13:57:36.830429 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:36.830159 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:36.853824 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:36.853769 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" podStartSLOduration=1.502751973 podStartE2EDuration="3.853750247s" totalImagesPullingTime="2.350998274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:57:36.85287859 +0000 UTC m=+785.197828925" watchObservedRunningTime="2026-06-09 13:57:36.853750247 +0000 UTC m=+785.198700586" Jun 09 13:57:47.837476 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:47.837387 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s2v4j" Jun 09 13:57:49.347617 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.347583 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2"] Jun 09 13:57:49.350611 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.350593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.353204 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.353182 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fkk6q\"" Jun 09 13:57:49.353334 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.353284 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 13:57:49.353334 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.353290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 13:57:49.365522 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.365494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2"] Jun 09 13:57:49.494351 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.494312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.494539 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.494366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.494539 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.494410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sff58\" (UniqueName: \"kubernetes.io/projected/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-kube-api-access-sff58\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.595021 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.594984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.595021 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.595022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.595216 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.595045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sff58\" (UniqueName: \"kubernetes.io/projected/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-kube-api-access-sff58\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.595216 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:57:49.595126 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 13:57:49.595216 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:57:49.595210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert podName:5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a nodeName:}" failed. No retries permitted until 2026-06-09 13:57:50.09518694 +0000 UTC m=+798.440137258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-c9nl2" (UID: "5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a") : secret "plugin-serving-cert" not found Jun 09 13:57:49.595600 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.595583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:49.609292 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:49.609239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sff58\" (UniqueName: \"kubernetes.io/projected/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-kube-api-access-sff58\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:50.099208 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:50.099162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:50.101573 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:50.101547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c9nl2\" (UID: \"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:50.259189 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:50.259155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" Jun 09 13:57:50.385061 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:50.385037 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2"] Jun 09 13:57:50.387440 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:57:50.387403 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b1cf6b6_c8a3_4e69_a41b_3e7759033f6a.slice/crio-e50a02cb9c5f9c76eb3523ed1866b7f2f348fcc6d3a6e92b063a78b368ba3e7a WatchSource:0}: Error finding container e50a02cb9c5f9c76eb3523ed1866b7f2f348fcc6d3a6e92b063a78b368ba3e7a: Status 404 returned error can't find the container with id e50a02cb9c5f9c76eb3523ed1866b7f2f348fcc6d3a6e92b063a78b368ba3e7a Jun 09 13:57:50.890246 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:50.890191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" event={"ID":"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a","Type":"ContainerStarted","Data":"e50a02cb9c5f9c76eb3523ed1866b7f2f348fcc6d3a6e92b063a78b368ba3e7a"} Jun 09 13:57:59.561692 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.561600 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d"] Jun 09 13:57:59.568486 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.568448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.571292 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.571266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h286c\"" Jun 09 13:57:59.585206 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.585179 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d"] Jun 09 13:57:59.682343 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.682306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.682564 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.682378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fddj\" (UniqueName: \"kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.783510 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.783446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.783698 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.783539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fddj\" (UniqueName: \"kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.783874 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.783846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.802830 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.802803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fddj\" (UniqueName: \"kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj\") pod \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:57:59.881838 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:57:59.881759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:00.069617 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.069578 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d"] Jun 09 13:58:00.075188 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.075156 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d"] Jun 09 13:58:00.099625 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.099591 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:00.110298 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.110266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.129077 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.129040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:00.287838 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.287795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7z5w\" (UniqueName: \"kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.288025 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.287885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.389106 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.389058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.389291 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.389133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7z5w\" (UniqueName: \"kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.389618 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.389587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.398383 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.398352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7z5w\" (UniqueName: \"kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcskd\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:00.424234 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:00.424207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:13.427309 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:13.427281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:13.428312 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:58:13.428286 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c70122_693d_42e2_9a1f_526ab7ae7a18.slice/crio-1c908a4efabd2491c063666e7335fae62a07253a660ee2182a1e57ccfa9db36c WatchSource:0}: Error finding container 1c908a4efabd2491c063666e7335fae62a07253a660ee2182a1e57ccfa9db36c: Status 404 returned error can't find the container with id 1c908a4efabd2491c063666e7335fae62a07253a660ee2182a1e57ccfa9db36c Jun 09 13:58:14.008375 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:14.008329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" event={"ID":"80c70122-693d-42e2-9a1f-526ab7ae7a18","Type":"ContainerStarted","Data":"1c908a4efabd2491c063666e7335fae62a07253a660ee2182a1e57ccfa9db36c"} Jun 09 13:58:14.009988 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:14.009953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" event={"ID":"5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a","Type":"ContainerStarted","Data":"a01cf2ca3606aeb33e498fc52801ee95337ab388714fed4f4a111f4e1258a76e"} Jun 09 13:58:14.047786 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:14.047724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c9nl2" podStartSLOduration=2.096714929 podStartE2EDuration="25.047704273s" totalImagesPullingTime="22.950989344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:14.047189104 +0000 UTC m=+822.392139447" watchObservedRunningTime="2026-06-09 13:58:14.047704273 +0000 UTC m=+822.392654623" Jun 09 13:58:15.812853 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:15.812817 2578 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8t42d_kuadrant-system_d28f75ee-1afd-40e4-a779-c4c6b8c398a6_0(a898ca0cc0bc514e4ec3e839c1c0281d12fe5c1dcc1fc5445205331ed5a0541d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8t42d to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 13:58:15.813213 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:15.812877 2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8t42d_kuadrant-system_d28f75ee-1afd-40e4-a779-c4c6b8c398a6_0(a898ca0cc0bc514e4ec3e839c1c0281d12fe5c1dcc1fc5445205331ed5a0541d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8t42d to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:16.019533 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.019496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:16.021814 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:16.021784 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" is forbidden: User \"system:node:ip-10-0-137-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-34.ec2.internal' and this object" podUID="d28f75ee-1afd-40e4-a779-c4c6b8c398a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:16.025544 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.025523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:16.029889 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:16.029864 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" is forbidden: User \"system:node:ip-10-0-137-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-34.ec2.internal' and this object" podUID="d28f75ee-1afd-40e4-a779-c4c6b8c398a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:16.124298 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.124227 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fddj\" (UniqueName: \"kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj\") pod \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " Jun 09 13:58:16.124298 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.124262 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume\") pod \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\" (UID: \"d28f75ee-1afd-40e4-a779-c4c6b8c398a6\") " Jun 09 13:58:16.124609 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.124570 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d28f75ee-1afd-40e4-a779-c4c6b8c398a6" (UID: "d28f75ee-1afd-40e4-a779-c4c6b8c398a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:58:16.126511 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.126489 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj" (OuterVolumeSpecName: "kube-api-access-4fddj") pod "d28f75ee-1afd-40e4-a779-c4c6b8c398a6" (UID: "d28f75ee-1afd-40e4-a779-c4c6b8c398a6"). InnerVolumeSpecName "kube-api-access-4fddj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:58:16.225810 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.225772 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fddj\" (UniqueName: \"kubernetes.io/projected/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-kube-api-access-4fddj\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:58:16.225810 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:16.225811 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28f75ee-1afd-40e4-a779-c4c6b8c398a6-extensions-socket-volume\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:58:17.023679 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:17.023645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:17.026515 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:17.026485 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" is forbidden: User \"system:node:ip-10-0-137-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-34.ec2.internal' and this object" podUID="d28f75ee-1afd-40e4-a779-c4c6b8c398a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:17.031318 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:17.031288 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8t42d\" is forbidden: User \"system:node:ip-10-0-137-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-34.ec2.internal' and this object" podUID="d28f75ee-1afd-40e4-a779-c4c6b8c398a6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8t42d" Jun 09 13:58:18.108128 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:18.108083 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28f75ee-1afd-40e4-a779-c4c6b8c398a6" path="/var/lib/kubelet/pods/d28f75ee-1afd-40e4-a779-c4c6b8c398a6/volumes" Jun 09 13:58:20.040038 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:20.039999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" event={"ID":"80c70122-693d-42e2-9a1f-526ab7ae7a18","Type":"ContainerStarted","Data":"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180"} Jun 09 13:58:20.040448 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:20.040142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:20.063480 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:20.063392 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" podStartSLOduration=14.162973703 podStartE2EDuration="20.063378114s" totalImagesPullingTime="5.900404411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:20.061386035 +0000 UTC m=+828.406336372" watchObservedRunningTime="2026-06-09 13:58:20.063378114 +0000 UTC m=+828.408328452" Jun 09 13:58:31.046567 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:31.046536 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:43.679287 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:43.679245 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:43.679909 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:43.679524 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" podUID="80c70122-693d-42e2-9a1f-526ab7ae7a18" containerName="manager" containerID="cri-o://cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180" gracePeriod=10 Jun 09 13:58:43.934516 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:43.934434 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:44.059442 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.059405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7z5w\" (UniqueName: \"kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w\") pod \"80c70122-693d-42e2-9a1f-526ab7ae7a18\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " Jun 09 13:58:44.059616 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.059505 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume\") pod \"80c70122-693d-42e2-9a1f-526ab7ae7a18\" (UID: \"80c70122-693d-42e2-9a1f-526ab7ae7a18\") " Jun 09 13:58:44.059855 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.059832 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80c70122-693d-42e2-9a1f-526ab7ae7a18" (UID: "80c70122-693d-42e2-9a1f-526ab7ae7a18"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 13:58:44.061704 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.061680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w" (OuterVolumeSpecName: "kube-api-access-h7z5w") pod "80c70122-693d-42e2-9a1f-526ab7ae7a18" (UID: "80c70122-693d-42e2-9a1f-526ab7ae7a18"). InnerVolumeSpecName "kube-api-access-h7z5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:58:44.149327 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.149290 2578 generic.go:356] "Generic (PLEG): container finished" podID="80c70122-693d-42e2-9a1f-526ab7ae7a18" containerID="cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180" exitCode=0 Jun 09 13:58:44.149327 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.149331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" event={"ID":"80c70122-693d-42e2-9a1f-526ab7ae7a18","Type":"ContainerDied","Data":"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180"} Jun 09 13:58:44.149584 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.149344 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" Jun 09 13:58:44.149584 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.149369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd" event={"ID":"80c70122-693d-42e2-9a1f-526ab7ae7a18","Type":"ContainerDied","Data":"1c908a4efabd2491c063666e7335fae62a07253a660ee2182a1e57ccfa9db36c"} Jun 09 13:58:44.149584 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.149391 2578 scope.go:117] "RemoveContainer" containerID="cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180" Jun 09 13:58:44.158552 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.158530 2578 scope.go:117] "RemoveContainer" containerID="cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180" Jun 09 13:58:44.158847 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:58:44.158830 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180\": container with ID starting with cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180 not found: ID does not exist" containerID="cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180" Jun 09 13:58:44.158895 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.158856 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180"} err="failed to get container status \"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180\": rpc error: code = NotFound desc = could not find container \"cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180\": container with ID starting with cc6522c5e52bfc7ce782018ffd2a76be85d53f04a2748350fcb47b0eb0682180 not found: ID does not exist" Jun 09 13:58:44.160180 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.160155 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7z5w\" (UniqueName: \"kubernetes.io/projected/80c70122-693d-42e2-9a1f-526ab7ae7a18-kube-api-access-h7z5w\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:58:44.160282 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.160207 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80c70122-693d-42e2-9a1f-526ab7ae7a18-extensions-socket-volume\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:58:44.167595 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.167567 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:44.175538 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:44.175514 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcskd"] Jun 09 13:58:46.106366 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:46.106334 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c70122-693d-42e2-9a1f-526ab7ae7a18" path="/var/lib/kubelet/pods/80c70122-693d-42e2-9a1f-526ab7ae7a18/volumes" Jun 09 13:58:52.112716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.112682 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:58:52.113103 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.112969 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c70122-693d-42e2-9a1f-526ab7ae7a18" containerName="manager" Jun 09 13:58:52.113103 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.112981 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c70122-693d-42e2-9a1f-526ab7ae7a18" containerName="manager" Jun 09 13:58:52.113103 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.113058 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c70122-693d-42e2-9a1f-526ab7ae7a18" containerName="manager" Jun 09 13:58:52.116502 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.116455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.119736 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.119718 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 13:58:52.128638 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.128615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:58:52.217607 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.217576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:58:52.225543 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.225510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgt2x\" (UniqueName: \"kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.225667 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.225574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.326793 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.326761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgt2x\" (UniqueName: \"kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.326953 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.326821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.327404 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.327385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.343759 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.343727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgt2x\" (UniqueName: \"kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x\") pod \"limitador-limitador-64c94fd64f-mh8gb\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.426493 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.426398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:52.561564 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:52.561539 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:58:52.564154 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:58:52.564115 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74884fbd_4812_4c24_adcb_064dab1f87da.slice/crio-bc1aad40338347fdc2f97761794cd8f86002c99c04c7aa33939625d50ddfae6d WatchSource:0}: Error finding container bc1aad40338347fdc2f97761794cd8f86002c99c04c7aa33939625d50ddfae6d: Status 404 returned error can't find the container with id bc1aad40338347fdc2f97761794cd8f86002c99c04c7aa33939625d50ddfae6d Jun 09 13:58:53.190830 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:53.190790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" event={"ID":"74884fbd-4812-4c24-adcb-064dab1f87da","Type":"ContainerStarted","Data":"bc1aad40338347fdc2f97761794cd8f86002c99c04c7aa33939625d50ddfae6d"} Jun 09 13:58:56.208314 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:56.208275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" event={"ID":"74884fbd-4812-4c24-adcb-064dab1f87da","Type":"ContainerStarted","Data":"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27"} Jun 09 13:58:56.208765 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:56.208417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:58:56.225319 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:58:56.225275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" podStartSLOduration=1.337373026 podStartE2EDuration="4.2252623s" totalImagesPullingTime="2.887889274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:58:56.22461432 +0000 UTC m=+864.569564679" watchObservedRunningTime="2026-06-09 13:58:56.2252623 +0000 UTC m=+864.570212636" Jun 09 13:59:07.213455 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:07.213423 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:59:08.502667 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:08.502634 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:59:08.503067 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:08.502804 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" podUID="74884fbd-4812-4c24-adcb-064dab1f87da" containerName="limitador" containerID="cri-o://bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27" gracePeriod=30 Jun 09 13:59:09.050728 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.050705 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:59:09.147396 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.147327 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file\") pod \"74884fbd-4812-4c24-adcb-064dab1f87da\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " Jun 09 13:59:09.147396 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.147390 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgt2x\" (UniqueName: \"kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x\") pod \"74884fbd-4812-4c24-adcb-064dab1f87da\" (UID: \"74884fbd-4812-4c24-adcb-064dab1f87da\") " Jun 09 13:59:09.147710 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.147688 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file" (OuterVolumeSpecName: "config-file") pod "74884fbd-4812-4c24-adcb-064dab1f87da" (UID: "74884fbd-4812-4c24-adcb-064dab1f87da"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 13:59:09.149416 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.149383 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x" (OuterVolumeSpecName: "kube-api-access-vgt2x") pod "74884fbd-4812-4c24-adcb-064dab1f87da" (UID: "74884fbd-4812-4c24-adcb-064dab1f87da"). InnerVolumeSpecName "kube-api-access-vgt2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 13:59:09.248180 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.248144 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74884fbd-4812-4c24-adcb-064dab1f87da-config-file\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:59:09.248319 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.248197 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgt2x\" (UniqueName: \"kubernetes.io/projected/74884fbd-4812-4c24-adcb-064dab1f87da-kube-api-access-vgt2x\") on node \"ip-10-0-137-34.ec2.internal\" DevicePath \"\"" Jun 09 13:59:09.264822 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.264792 2578 generic.go:356] "Generic (PLEG): container finished" podID="74884fbd-4812-4c24-adcb-064dab1f87da" containerID="bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27" exitCode=0 Jun 09 13:59:09.264937 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.264847 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" Jun 09 13:59:09.264937 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.264873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" event={"ID":"74884fbd-4812-4c24-adcb-064dab1f87da","Type":"ContainerDied","Data":"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27"} Jun 09 13:59:09.265023 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.264958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mh8gb" event={"ID":"74884fbd-4812-4c24-adcb-064dab1f87da","Type":"ContainerDied","Data":"bc1aad40338347fdc2f97761794cd8f86002c99c04c7aa33939625d50ddfae6d"} Jun 09 13:59:09.265023 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.264987 2578 scope.go:117] "RemoveContainer" containerID="bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27" Jun 09 13:59:09.272567 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.272542 2578 scope.go:117] "RemoveContainer" containerID="bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27" Jun 09 13:59:09.272895 ip-10-0-137-34 kubenswrapper[2578]: E0609 13:59:09.272873 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27\": container with ID starting with bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27 not found: ID does not exist" containerID="bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27" Jun 09 13:59:09.272972 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.272911 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27"} err="failed to get container status \"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27\": rpc error: code = NotFound desc = could not find container \"bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27\": container with ID starting with bdd0389ad43fd54c77ac05a0082799533fdfb46d02b306a5207e91b1bde5bb27 not found: ID does not exist" Jun 09 13:59:09.286703 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.286677 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:59:09.293244 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:09.293226 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mh8gb"] Jun 09 13:59:10.106410 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:10.106344 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74884fbd-4812-4c24-adcb-064dab1f87da" path="/var/lib/kubelet/pods/74884fbd-4812-4c24-adcb-064dab1f87da/volumes" Jun 09 13:59:14.659870 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.659833 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29"] Jun 09 13:59:14.660377 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.660346 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74884fbd-4812-4c24-adcb-064dab1f87da" containerName="limitador" Jun 09 13:59:14.660377 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.660376 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74884fbd-4812-4c24-adcb-064dab1f87da" containerName="limitador" Jun 09 13:59:14.660566 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.660519 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="74884fbd-4812-4c24-adcb-064dab1f87da" containerName="limitador" Jun 09 13:59:14.664975 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.664953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.669229 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.669208 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 13:59:14.669341 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.669226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-4ph9j\"" Jun 09 13:59:14.670230 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.670214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 09 13:59:14.670320 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.670249 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 13:59:14.677090 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.677066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29"] Jun 09 13:59:14.687589 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.687566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhmq\" (UniqueName: \"kubernetes.io/projected/7499cc37-c490-48af-bacc-b27b767253b5-kube-api-access-8mhmq\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.687684 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.687617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7499cc37-c490-48af-bacc-b27b767253b5-data\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.788747 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.788717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhmq\" (UniqueName: \"kubernetes.io/projected/7499cc37-c490-48af-bacc-b27b767253b5-kube-api-access-8mhmq\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.788886 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.788761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7499cc37-c490-48af-bacc-b27b767253b5-data\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.789097 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.789080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7499cc37-c490-48af-bacc-b27b767253b5-data\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.797387 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.797356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhmq\" (UniqueName: \"kubernetes.io/projected/7499cc37-c490-48af-bacc-b27b767253b5-kube-api-access-8mhmq\") pod \"postgres-69fb4594cf-5hk29\" (UID: \"7499cc37-c490-48af-bacc-b27b767253b5\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:14.976518 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:14.976430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:15.105875 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:15.105831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29"] Jun 09 13:59:15.108101 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:59:15.108070 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7499cc37_c490_48af_bacc_b27b767253b5.slice/crio-d77efdcaac16bf197fd23d69ee01645026ce4fa0821300dd5aa8bcf32f820615 WatchSource:0}: Error finding container d77efdcaac16bf197fd23d69ee01645026ce4fa0821300dd5aa8bcf32f820615: Status 404 returned error can't find the container with id d77efdcaac16bf197fd23d69ee01645026ce4fa0821300dd5aa8bcf32f820615 Jun 09 13:59:15.290675 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:15.290644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" event={"ID":"7499cc37-c490-48af-bacc-b27b767253b5","Type":"ContainerStarted","Data":"d77efdcaac16bf197fd23d69ee01645026ce4fa0821300dd5aa8bcf32f820615"} Jun 09 13:59:20.319950 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:20.319916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" event={"ID":"7499cc37-c490-48af-bacc-b27b767253b5","Type":"ContainerStarted","Data":"df68a69f13809ba86a078ef0f17472f2caac2d936f903c564eaf2799f00619c6"} Jun 09 13:59:20.320401 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:20.320025 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:20.341806 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:20.341743 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" podStartSLOduration=1.503258816 podStartE2EDuration="6.341720747s" totalImagesPullingTime="4.838461931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:59:20.339891759 +0000 UTC m=+888.684842096" watchObservedRunningTime="2026-06-09 13:59:20.341720747 +0000 UTC m=+888.686671084" Jun 09 13:59:26.353130 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:26.353102 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-5hk29" Jun 09 13:59:32.092255 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:32.092217 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:59:32.092759 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:32.092391 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 13:59:36.680998 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.680968 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9qb2"] Jun 09 13:59:36.687971 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.687949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" Jun 09 13:59:36.690698 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.690681 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-669zm\"" Jun 09 13:59:36.690778 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.690747 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 13:59:36.691722 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.691706 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 13:59:36.697282 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.697258 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9qb2"] Jun 09 13:59:36.755716 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.755684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sk5s\" (UniqueName: \"kubernetes.io/projected/a81ed7f3-25c9-482f-bd20-e1d4588f0534-kube-api-access-7sk5s\") pod \"keycloak-operator-d67dbbb48-q9qb2\" (UID: \"a81ed7f3-25c9-482f-bd20-e1d4588f0534\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" Jun 09 13:59:36.856635 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.856606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sk5s\" (UniqueName: \"kubernetes.io/projected/a81ed7f3-25c9-482f-bd20-e1d4588f0534-kube-api-access-7sk5s\") pod \"keycloak-operator-d67dbbb48-q9qb2\" (UID: \"a81ed7f3-25c9-482f-bd20-e1d4588f0534\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" Jun 09 13:59:36.874646 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.874624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sk5s\" (UniqueName: \"kubernetes.io/projected/a81ed7f3-25c9-482f-bd20-e1d4588f0534-kube-api-access-7sk5s\") pod \"keycloak-operator-d67dbbb48-q9qb2\" (UID: \"a81ed7f3-25c9-482f-bd20-e1d4588f0534\") " pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" Jun 09 13:59:36.998832 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:36.998808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" Jun 09 13:59:37.130817 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:37.130785 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-q9qb2"] Jun 09 13:59:37.134456 ip-10-0-137-34 kubenswrapper[2578]: W0609 13:59:37.134431 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81ed7f3_25c9_482f_bd20_e1d4588f0534.slice/crio-0d75dfe855f52fe9ef01e7b20a36d7d2f8565ec67e9bbf890a2b95af4a2658dd WatchSource:0}: Error finding container 0d75dfe855f52fe9ef01e7b20a36d7d2f8565ec67e9bbf890a2b95af4a2658dd: Status 404 returned error can't find the container with id 0d75dfe855f52fe9ef01e7b20a36d7d2f8565ec67e9bbf890a2b95af4a2658dd Jun 09 13:59:37.392713 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:37.392643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" event={"ID":"a81ed7f3-25c9-482f-bd20-e1d4588f0534","Type":"ContainerStarted","Data":"0d75dfe855f52fe9ef01e7b20a36d7d2f8565ec67e9bbf890a2b95af4a2658dd"} Jun 09 13:59:43.427550 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:43.427504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" event={"ID":"a81ed7f3-25c9-482f-bd20-e1d4588f0534","Type":"ContainerStarted","Data":"d06b1695045a2fd599cb7fb7c4300402563a5d1657563b5fbfb324ac6c9ed42f"} Jun 09 13:59:43.455590 ip-10-0-137-34 kubenswrapper[2578]: I0609 13:59:43.455494 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-q9qb2" podStartSLOduration=1.397342794 podStartE2EDuration="7.455455588s" totalImagesPullingTime="6.058112794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:59:43.45481166 +0000 UTC m=+911.799761996" watchObservedRunningTime="2026-06-09 13:59:43.455455588 +0000 UTC m=+911.800405926" Jun 09 14:01:57.005657 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.005624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9"] Jun 09 14:01:57.007902 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.007882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.010672 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.010648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 14:01:57.010804 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.010787 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 14:01:57.012050 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.012032 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 14:01:57.012160 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.012116 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-csvmt\"" Jun 09 14:01:57.021194 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.021175 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9"] Jun 09 14:01:57.176580 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.176709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.176709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.176709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.176709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.176847 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.176725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fw5v\" (UniqueName: \"kubernetes.io/projected/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kube-api-access-6fw5v\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277456 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277456 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277628 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277628 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fw5v\" (UniqueName: \"kubernetes.io/projected/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kube-api-access-6fw5v\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277628 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277628 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.277905 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.277878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.278043 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.278018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.278154 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.278137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.279767 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.279743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.280010 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.279993 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.286270 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.286247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fw5v\" (UniqueName: \"kubernetes.io/projected/9daaf19b-9fc1-41a1-a18f-f402053fe9e1-kube-api-access-6fw5v\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9\" (UID: \"9daaf19b-9fc1-41a1-a18f-f402053fe9e1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.318442 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.318418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" Jun 09 14:01:57.453408 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.453384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9"] Jun 09 14:01:57.456166 ip-10-0-137-34 kubenswrapper[2578]: W0609 14:01:57.456139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9daaf19b_9fc1_41a1_a18f_f402053fe9e1.slice/crio-f0705aabb4ccc81160ca01058aebf96cf6998534c952b0552ffcc9b04448ba6f WatchSource:0}: Error finding container f0705aabb4ccc81160ca01058aebf96cf6998534c952b0552ffcc9b04448ba6f: Status 404 returned error can't find the container with id f0705aabb4ccc81160ca01058aebf96cf6998534c952b0552ffcc9b04448ba6f Jun 09 14:01:57.458033 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:57.458015 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:01:58.014367 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:01:58.014334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" event={"ID":"9daaf19b-9fc1-41a1-a18f-f402053fe9e1","Type":"ContainerStarted","Data":"f0705aabb4ccc81160ca01058aebf96cf6998534c952b0552ffcc9b04448ba6f"} Jun 09 14:02:02.035713 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:02.035683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9" event={"ID":"9daaf19b-9fc1-41a1-a18f-f402053fe9e1","Type":"ContainerStarted","Data":"8c9b7ac9cf600c0fd593e79a579f4bb23bbf856fd34c4d8f11bba3bf1b7f6d82"} Jun 09 14:02:36.296398 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.296370 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc"] Jun 09 14:02:36.315777 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.315754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc"] Jun 09 14:02:36.315920 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.315843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.318387 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.318361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 14:02:36.365160 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.365269 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.365269 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.365357 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76fe612d-aa6d-449a-bc3a-2b9415f53d99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.365357 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.365428 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.365365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d27z\" (UniqueName: \"kubernetes.io/projected/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kube-api-access-4d27z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465672 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465779 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d27z\" (UniqueName: \"kubernetes.io/projected/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kube-api-access-4d27z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465779 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465779 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465779 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.465779 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.465774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76fe612d-aa6d-449a-bc3a-2b9415f53d99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.466038 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.466019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.466264 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.466238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.466356 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.466261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.467742 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.467724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76fe612d-aa6d-449a-bc3a-2b9415f53d99-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.468042 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.468024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76fe612d-aa6d-449a-bc3a-2b9415f53d99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.474244 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.474218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d27z\" (UniqueName: \"kubernetes.io/projected/76fe612d-aa6d-449a-bc3a-2b9415f53d99-kube-api-access-4d27z\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc\" (UID: \"76fe612d-aa6d-449a-bc3a-2b9415f53d99\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.627285 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.627236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:36.752243 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:36.752218 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc"] Jun 09 14:02:36.754676 ip-10-0-137-34 kubenswrapper[2578]: W0609 14:02:36.754649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fe612d_aa6d_449a_bc3a_2b9415f53d99.slice/crio-c107570939c052e4ef84911c37b9d61a17b3c715142d7112ed2f59078973d197 WatchSource:0}: Error finding container c107570939c052e4ef84911c37b9d61a17b3c715142d7112ed2f59078973d197: Status 404 returned error can't find the container with id c107570939c052e4ef84911c37b9d61a17b3c715142d7112ed2f59078973d197 Jun 09 14:02:37.188343 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:37.188303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" event={"ID":"76fe612d-aa6d-449a-bc3a-2b9415f53d99","Type":"ContainerStarted","Data":"7664f49669dffdcca0d32a6e7f1e2114e3279a6f719e5853accfaff85a8b883a"} Jun 09 14:02:37.188543 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:37.188361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" event={"ID":"76fe612d-aa6d-449a-bc3a-2b9415f53d99","Type":"ContainerStarted","Data":"c107570939c052e4ef84911c37b9d61a17b3c715142d7112ed2f59078973d197"} Jun 09 14:02:38.193486 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.193435 2578 generic.go:356] "Generic (PLEG): container finished" podID="76fe612d-aa6d-449a-bc3a-2b9415f53d99" containerID="7664f49669dffdcca0d32a6e7f1e2114e3279a6f719e5853accfaff85a8b883a" exitCode=0 Jun 09 14:02:38.193786 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.193503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" event={"ID":"76fe612d-aa6d-449a-bc3a-2b9415f53d99","Type":"ContainerDied","Data":"7664f49669dffdcca0d32a6e7f1e2114e3279a6f719e5853accfaff85a8b883a"} Jun 09 14:02:38.885242 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.885205 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6"] Jun 09 14:02:38.888901 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.888876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.891536 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.891516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 14:02:38.901185 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.901152 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6"] Jun 09 14:02:38.984965 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.984934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd0c1ed-af46-4de7-bc1c-1890423d3463-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.985188 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.984971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.985188 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.985021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.985188 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.985104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.985188 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.985137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:38.985188 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:38.985168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxq7f\" (UniqueName: \"kubernetes.io/projected/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kube-api-access-gxq7f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.086667 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.086626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.086843 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.086688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.086843 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.086725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxq7f\" (UniqueName: \"kubernetes.io/projected/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kube-api-access-gxq7f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.086843 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.086758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd0c1ed-af46-4de7-bc1c-1890423d3463-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.087103 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.087052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.087206 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.087064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.087206 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.087157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.087332 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.087304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.087525 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.087503 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.089900 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.089876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdd0c1ed-af46-4de7-bc1c-1890423d3463-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.090083 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.090065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdd0c1ed-af46-4de7-bc1c-1890423d3463-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.096097 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.096077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxq7f\" (UniqueName: \"kubernetes.io/projected/cdd0c1ed-af46-4de7-bc1c-1890423d3463-kube-api-access-gxq7f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6\" (UID: \"cdd0c1ed-af46-4de7-bc1c-1890423d3463\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.202740 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.202668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:02:39.379268 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:39.379243 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6"] Jun 09 14:02:39.380759 ip-10-0-137-34 kubenswrapper[2578]: W0609 14:02:39.380736 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd0c1ed_af46_4de7_bc1c_1890423d3463.slice/crio-35af46b6610dcd97e66357a9f8a799160fb3a0fd71e2f58c5ef0a91a1443eb0e WatchSource:0}: Error finding container 35af46b6610dcd97e66357a9f8a799160fb3a0fd71e2f58c5ef0a91a1443eb0e: Status 404 returned error can't find the container with id 35af46b6610dcd97e66357a9f8a799160fb3a0fd71e2f58c5ef0a91a1443eb0e Jun 09 14:02:40.205721 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:40.205687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" event={"ID":"76fe612d-aa6d-449a-bc3a-2b9415f53d99","Type":"ContainerStarted","Data":"da0bbb4265247e92ee6b1eef20d11c231d14dcb000b6dec863c4ae6f3d347839"} Jun 09 14:02:40.207308 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:40.207280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" event={"ID":"cdd0c1ed-af46-4de7-bc1c-1890423d3463","Type":"ContainerStarted","Data":"36c47183b2c668b4df37373658a085c4c600adf517bf6c88b0883cd91cf44687"} Jun 09 14:02:40.207435 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:40.207323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" event={"ID":"cdd0c1ed-af46-4de7-bc1c-1890423d3463","Type":"ContainerStarted","Data":"35af46b6610dcd97e66357a9f8a799160fb3a0fd71e2f58c5ef0a91a1443eb0e"} Jun 09 14:02:40.225272 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:40.225229 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" podStartSLOduration=1.9261265239999998 podStartE2EDuration="4.225215673s" totalImagesPullingTime="1.105790704s" totalInitContainerRuntime="1.193298445s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:02:40.223092233 +0000 UTC m=+1088.568042571" watchObservedRunningTime="2026-06-09 14:02:40.225215673 +0000 UTC m=+1088.570166008" Jun 09 14:02:42.684615 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.684584 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99"] Jun 09 14:02:42.689929 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.689909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.692487 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.692444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 14:02:42.698892 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.698872 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99"] Jun 09 14:02:42.817720 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw75g\" (UniqueName: \"kubernetes.io/projected/49340dc2-47f5-413e-a229-f1ac0823519b-kube-api-access-fw75g\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.817858 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.817858 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.817858 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.818019 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.818019 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.817893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49340dc2-47f5-413e-a229-f1ac0823519b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918717 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw75g\" (UniqueName: \"kubernetes.io/projected/49340dc2-47f5-413e-a229-f1ac0823519b-kube-api-access-fw75g\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918852 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918852 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918852 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918852 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.918852 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.918830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49340dc2-47f5-413e-a229-f1ac0823519b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.919168 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.919131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.919270 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.919193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.919270 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.919217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.921032 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.921005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49340dc2-47f5-413e-a229-f1ac0823519b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.921285 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.921264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49340dc2-47f5-413e-a229-f1ac0823519b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:42.929538 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:42.929516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw75g\" (UniqueName: \"kubernetes.io/projected/49340dc2-47f5-413e-a229-f1ac0823519b-kube-api-access-fw75g\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4vb99\" (UID: \"49340dc2-47f5-413e-a229-f1ac0823519b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:43.001977 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:43.001959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:43.130864 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:43.130827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99"] Jun 09 14:02:43.132884 ip-10-0-137-34 kubenswrapper[2578]: W0609 14:02:43.132860 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49340dc2_47f5_413e_a229_f1ac0823519b.slice/crio-0c2ea9a3f12008abfbcca3c706b655d137fd77757a2c01eba336ad68f3583f9a WatchSource:0}: Error finding container 0c2ea9a3f12008abfbcca3c706b655d137fd77757a2c01eba336ad68f3583f9a: Status 404 returned error can't find the container with id 0c2ea9a3f12008abfbcca3c706b655d137fd77757a2c01eba336ad68f3583f9a Jun 09 14:02:43.221782 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:43.221750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" event={"ID":"49340dc2-47f5-413e-a229-f1ac0823519b","Type":"ContainerStarted","Data":"1353f6b0bd28c139ecaea02badd6f5e43be4c9e8e9b57a41a912abde5621d201"} Jun 09 14:02:43.221908 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:43.221803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" event={"ID":"49340dc2-47f5-413e-a229-f1ac0823519b","Type":"ContainerStarted","Data":"0c2ea9a3f12008abfbcca3c706b655d137fd77757a2c01eba336ad68f3583f9a"} Jun 09 14:02:46.628104 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:46.628030 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:46.628104 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:46.628089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:46.640082 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:46.640058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:47.241974 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:47.241941 2578 generic.go:356] "Generic (PLEG): container finished" podID="49340dc2-47f5-413e-a229-f1ac0823519b" containerID="1353f6b0bd28c139ecaea02badd6f5e43be4c9e8e9b57a41a912abde5621d201" exitCode=0 Jun 09 14:02:47.242161 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:47.242012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" event={"ID":"49340dc2-47f5-413e-a229-f1ac0823519b","Type":"ContainerDied","Data":"1353f6b0bd28c139ecaea02badd6f5e43be4c9e8e9b57a41a912abde5621d201"} Jun 09 14:02:47.253544 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:47.253522 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc" Jun 09 14:02:48.248309 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:48.248276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" event={"ID":"49340dc2-47f5-413e-a229-f1ac0823519b","Type":"ContainerStarted","Data":"dba076213b223f46bf3fe23bc27906eb852419f4c52b5927d9bd6b68331e8280"} Jun 09 14:02:48.277434 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:48.277386 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" podStartSLOduration=2.858332729 podStartE2EDuration="6.27737294s" totalImagesPullingTime="267.783409ms" totalInitContainerRuntime="3.151256802s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:02:48.276298401 +0000 UTC m=+1096.621248737" watchObservedRunningTime="2026-06-09 14:02:48.27737294 +0000 UTC m=+1096.622323313" Jun 09 14:02:53.002507 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:53.002447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:53.002890 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:53.002532 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:53.014489 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:53.014449 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:02:53.281066 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:02:53.280986 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4vb99" Jun 09 14:03:31.444722 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:31.444688 2578 generic.go:356] "Generic (PLEG): container finished" podID="cdd0c1ed-af46-4de7-bc1c-1890423d3463" containerID="36c47183b2c668b4df37373658a085c4c600adf517bf6c88b0883cd91cf44687" exitCode=0 Jun 09 14:03:31.445154 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:31.444762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" event={"ID":"cdd0c1ed-af46-4de7-bc1c-1890423d3463","Type":"ContainerDied","Data":"36c47183b2c668b4df37373658a085c4c600adf517bf6c88b0883cd91cf44687"} Jun 09 14:03:33.456874 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:33.456835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" event={"ID":"cdd0c1ed-af46-4de7-bc1c-1890423d3463","Type":"ContainerStarted","Data":"fb3604592189b3c188e0d9b6e2392bcf08e2b23b69b303510bbd8e6e8906eebe"} Jun 09 14:03:33.477037 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:33.476983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" podStartSLOduration=2.10406129 podStartE2EDuration="55.476969312s" totalImagesPullingTime="1.519049603s" totalInitContainerRuntime="51.853858419s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:03:33.475362011 +0000 UTC m=+1141.820312371" watchObservedRunningTime="2026-06-09 14:03:33.476969312 +0000 UTC m=+1141.821919649" Jun 09 14:03:39.202876 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:39.202843 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:03:39.203302 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:39.202911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:03:39.215276 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:39.215252 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:03:39.496858 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:03:39.496833 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6" Jun 09 14:04:32.121334 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:04:32.121274 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 14:04:32.123535 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:04:32.123508 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 14:09:32.149670 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:09:32.149637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 14:09:32.152793 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:09:32.152767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 14:13:40.606322 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:40.606294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f4cf5f6dc-vm7mt_6a5b5742-8e7e-4b8d-a91f-7a05d34e9638/nginx/0.log" Jun 09 14:13:40.711342 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:40.711306 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mt7q6_e9806343-8c3d-444c-91c7-a1f86505e7ad/manager/0.log" Jun 09 14:13:40.830501 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:40.830473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4x6n7_1fb44d70-f49f-4191-a1f1-f20a6d75da29/manager/0.log" Jun 09 14:13:41.068982 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:41.068943 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dpkpd_3208bc74-ba6c-4d6e-b190-474e354d1b96/server/0.log" Jun 09 14:13:41.182378 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:41.182339 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kd5dr_959e6c1a-ddfa-4ed8-83f0-829c0f03bab2/manager/0.log" Jun 09 14:13:41.527562 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:41.527532 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zjpbd_d5976b5b-7246-40f1-912f-053525781881/copy-manifests/0.log" Jun 09 14:13:41.539709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:41.539681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zjpbd_d5976b5b-7246-40f1-912f-053525781881/manager/0.log" Jun 09 14:13:43.034763 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:43.034733 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s2v4j_892dd560-8708-4e70-8629-075a53c2dd81/manager/0.log" Jun 09 14:13:43.141321 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:43.141294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c9nl2_5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a/kuadrant-console-plugin/0.log" Jun 09 14:13:44.120563 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:44.120530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5865r_a067bdde-8af6-4fd5-ad17-569f02113d1b/discovery/0.log" Jun 09 14:13:44.238333 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:44.238303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-586f49fcfd-gmpr9_86a9212a-91af-42eb-9ec2-28e017d6a681/kube-auth-proxy/0.log" Jun 09 14:13:45.140069 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.140039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-p6mq9_9daaf19b-9fc1-41a1-a18f-f402053fe9e1/storage-initializer/0.log" Jun 09 14:13:45.384949 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.384921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc_76fe612d-aa6d-449a-bc3a-2b9415f53d99/storage-initializer/0.log" Jun 09 14:13:45.391819 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.391774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7c5sc_76fe612d-aa6d-449a-bc3a-2b9415f53d99/main/0.log" Jun 09 14:13:45.502741 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.502716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6_cdd0c1ed-af46-4de7-bc1c-1890423d3463/storage-initializer/0.log" Jun 09 14:13:45.509697 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.509667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cc78v6_cdd0c1ed-af46-4de7-bc1c-1890423d3463/main/0.log" Jun 09 14:13:45.618250 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.618223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4vb99_49340dc2-47f5-413e-a229-f1ac0823519b/storage-initializer/0.log" Jun 09 14:13:45.624709 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:45.624689 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4vb99_49340dc2-47f5-413e-a229-f1ac0823519b/main/0.log" Jun 09 14:13:53.591433 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:53.591402 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7npwn_c3e7cb8e-453b-4142-9626-66cdd842f114/global-pull-secret-syncer/0.log" Jun 09 14:13:53.787111 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:53.787078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbhph_ef2585d4-4314-42f1-b86c-c43be883576e/konnectivity-agent/0.log" Jun 09 14:13:53.856742 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:53.856675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-34.ec2.internal_7aa2be1dfc9f4320165bfbdb55271e05/haproxy/0.log" Jun 09 14:13:56.620035 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:56.620005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-dndbr_07b7f8e1-8701-4f00-8e1e-c07a5cffecfb/sail-operator/0.log" Jun 09 14:13:58.919429 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:58.919396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s2v4j_892dd560-8708-4e70-8629-075a53c2dd81/manager/0.log" Jun 09 14:13:58.945158 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:13:58.945133 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c9nl2_5b1cf6b6-c8a3-4e69-a41b-3e7759033f6a/kuadrant-console-plugin/0.log" Jun 09 14:14:01.071021 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:01.070993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgssx_b237148a-e32f-4d4d-8baf-004eaa85f98a/node-exporter/0.log" Jun 09 14:14:01.096110 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:01.096079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgssx_b237148a-e32f-4d4d-8baf-004eaa85f98a/kube-rbac-proxy/0.log" Jun 09 14:14:01.133304 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:01.133281 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgssx_b237148a-e32f-4d4d-8baf-004eaa85f98a/init-textfile/0.log" Jun 09 14:14:05.137801 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.137765 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv"] Jun 09 14:14:05.141570 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.141547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.144295 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.144275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-747d5\"/\"default-dockercfg-pntdp\"" Jun 09 14:14:05.144403 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.144275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-747d5\"/\"openshift-service-ca.crt\"" Jun 09 14:14:05.144403 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.144277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-747d5\"/\"kube-root-ca.crt\"" Jun 09 14:14:05.152103 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.152082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv"] Jun 09 14:14:05.226730 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.226700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-proc\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.226875 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.226780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-lib-modules\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.226875 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.226798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-podres\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.226875 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.226832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4r7\" (UniqueName: \"kubernetes.io/projected/4288796c-ab2a-402e-8e0c-3b7e2df88f51-kube-api-access-9q4r7\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.226875 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.226870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-sys\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328006 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.327976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4r7\" (UniqueName: \"kubernetes.io/projected/4288796c-ab2a-402e-8e0c-3b7e2df88f51-kube-api-access-9q4r7\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328146 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-sys\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328146 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-proc\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328146 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-sys\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328279 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-lib-modules\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328279 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-proc\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328279 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-podres\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328279 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-lib-modules\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.328401 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.328283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4288796c-ab2a-402e-8e0c-3b7e2df88f51-podres\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.338135 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.338108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4r7\" (UniqueName: \"kubernetes.io/projected/4288796c-ab2a-402e-8e0c-3b7e2df88f51-kube-api-access-9q4r7\") pod \"perf-node-gather-daemonset-lgbtv\" (UID: \"4288796c-ab2a-402e-8e0c-3b7e2df88f51\") " pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.451975 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.451903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:05.604534 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:05.604503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv"] Jun 09 14:14:05.605986 ip-10-0-137-34 kubenswrapper[2578]: W0609 14:14:05.605960 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4288796c_ab2a_402e_8e0c_3b7e2df88f51.slice/crio-1c48db02bbb4fb8a7bb2298274e0086514b5f340494822ac40414d575ca3bb46 WatchSource:0}: Error finding container 1c48db02bbb4fb8a7bb2298274e0086514b5f340494822ac40414d575ca3bb46: Status 404 returned error can't find the container with id 1c48db02bbb4fb8a7bb2298274e0086514b5f340494822ac40414d575ca3bb46 Jun 09 14:14:06.399164 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.399125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" event={"ID":"4288796c-ab2a-402e-8e0c-3b7e2df88f51","Type":"ContainerStarted","Data":"ba66c9443537b34f6de6dfac301d99e1feaf2691e400f49ec5bd86f58bebd5aa"} Jun 09 14:14:06.399565 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.399190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" event={"ID":"4288796c-ab2a-402e-8e0c-3b7e2df88f51","Type":"ContainerStarted","Data":"1c48db02bbb4fb8a7bb2298274e0086514b5f340494822ac40414d575ca3bb46"} Jun 09 14:14:06.399565 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.399217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:06.420154 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.420105 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" podStartSLOduration=1.42009005 podStartE2EDuration="1.42009005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:14:06.418346309 +0000 UTC m=+1774.763296647" watchObservedRunningTime="2026-06-09 14:14:06.42009005 +0000 UTC m=+1774.765040385" Jun 09 14:14:06.719806 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.719720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfj82_cbed5b72-1743-4901-b9c8-a051638b4433/dns/0.log" Jun 09 14:14:06.747031 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.747004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfj82_cbed5b72-1743-4901-b9c8-a051638b4433/kube-rbac-proxy/0.log" Jun 09 14:14:06.878646 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:06.878616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6ghkr_5cb95f79-c0b7-446e-a06e-7ab515c776d9/dns-node-resolver/0.log" Jun 09 14:14:07.562782 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:07.562752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gxfdw_855f1066-4992-41f8-bacc-577dad05f34c/node-ca/0.log" Jun 09 14:14:08.596164 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:08.596138 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5865r_a067bdde-8af6-4fd5-ad17-569f02113d1b/discovery/0.log" Jun 09 14:14:08.618340 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:08.618318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-586f49fcfd-gmpr9_86a9212a-91af-42eb-9ec2-28e017d6a681/kube-auth-proxy/0.log" Jun 09 14:14:09.465989 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:09.465961 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b6qmn_2d48601b-fc2a-4136-bac3-567b23abf91a/serve-healthcheck-canary/0.log" Jun 09 14:14:10.169177 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:10.169148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlf6x_aaf97b45-23bf-411f-9bbf-54954bd746f5/kube-rbac-proxy/0.log" Jun 09 14:14:10.194452 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:10.194431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlf6x_aaf97b45-23bf-411f-9bbf-54954bd746f5/exporter/0.log" Jun 09 14:14:10.217415 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:10.217394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlf6x_aaf97b45-23bf-411f-9bbf-54954bd746f5/extractor/0.log" Jun 09 14:14:12.413094 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.413071 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-747d5/perf-node-gather-daemonset-lgbtv" Jun 09 14:14:12.546754 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.546721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5f4cf5f6dc-vm7mt_6a5b5742-8e7e-4b8d-a91f-7a05d34e9638/nginx/0.log" Jun 09 14:14:12.572675 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.572655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mt7q6_e9806343-8c3d-444c-91c7-a1f86505e7ad/manager/0.log" Jun 09 14:14:12.622570 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.622534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4x6n7_1fb44d70-f49f-4191-a1f1-f20a6d75da29/manager/0.log" Jun 09 14:14:12.699291 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.699223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dpkpd_3208bc74-ba6c-4d6e-b190-474e354d1b96/server/0.log" Jun 09 14:14:12.751209 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:12.751177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kd5dr_959e6c1a-ddfa-4ed8-83f0-829c0f03bab2/manager/0.log" Jun 09 14:14:13.036508 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:13.036480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zjpbd_d5976b5b-7246-40f1-912f-053525781881/manager/0.log" Jun 09 14:14:13.053630 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:13.053605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7877c79489-zjpbd_d5976b5b-7246-40f1-912f-053525781881/copy-manifests/0.log" Jun 09 14:14:14.542611 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:14.542584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mzv5z_6ae9d0d4-6faf-4cf1-9804-1356513e8ee6/openshift-lws-operator/0.log" Jun 09 14:14:19.192964 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:19.192935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5865r_a067bdde-8af6-4fd5-ad17-569f02113d1b/discovery/0.log" Jun 09 14:14:19.205431 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:19.205408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-586f49fcfd-gmpr9_86a9212a-91af-42eb-9ec2-28e017d6a681/kube-auth-proxy/0.log" Jun 09 14:14:20.483263 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:20.483231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5865r_a067bdde-8af6-4fd5-ad17-569f02113d1b/discovery/0.log" Jun 09 14:14:20.495529 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:20.495509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-586f49fcfd-gmpr9_86a9212a-91af-42eb-9ec2-28e017d6a681/kube-auth-proxy/0.log" Jun 09 14:14:22.239738 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.239714 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-27lnz_5a70770c-9b14-4b70-bb29-5c7560b6acb3/kube-multus/0.log" Jun 09 14:14:22.418074 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.418045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5865r_a067bdde-8af6-4fd5-ad17-569f02113d1b/discovery/0.log" Jun 09 14:14:22.434405 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.434382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-586f49fcfd-gmpr9_86a9212a-91af-42eb-9ec2-28e017d6a681/kube-auth-proxy/0.log" Jun 09 14:14:22.489661 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.489632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/kube-multus-additional-cni-plugins/0.log" Jun 09 14:14:22.513305 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.513233 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/egress-router-binary-copy/0.log" Jun 09 14:14:22.535802 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.535782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/cni-plugins/0.log" Jun 09 14:14:22.558789 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.558768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/bond-cni-plugin/0.log" Jun 09 14:14:22.583338 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.583319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/routeoverride-cni/0.log" Jun 09 14:14:22.606965 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.606941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/whereabouts-cni-bincopy/0.log" Jun 09 14:14:22.629044 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.629016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dwrml_5b940780-c069-4d8d-ab26-ec35a783971d/whereabouts-cni/0.log" Jun 09 14:14:22.968804 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.968728 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qhgg_37ce0a49-a45f-4d83-b916-a7db6704ca11/network-metrics-daemon/0.log" Jun 09 14:14:22.992604 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:22.992578 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qhgg_37ce0a49-a45f-4d83-b916-a7db6704ca11/kube-rbac-proxy/0.log" Jun 09 14:14:24.078763 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.078738 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-controller/0.log" Jun 09 14:14:24.114157 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.114132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/0.log" Jun 09 14:14:24.114557 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.114546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/ovn-acl-logging/1.log" Jun 09 14:14:24.137572 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.137550 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/kube-rbac-proxy-node/0.log" Jun 09 14:14:24.160122 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.160102 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 14:14:24.177608 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.177589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/northd/0.log" Jun 09 14:14:24.199045 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.199026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/nbdb/0.log" Jun 09 14:14:24.222254 ip-10-0-137-34 kubenswrapper[2578]: I0609 14:14:24.222235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ff8g_570a7e3d-55be-4402-a77c-faaba0d794a6/sbdb/0.log"