Jun 10 15:01:38.664830 ip-10-0-141-243 systemd[1]: Starting Kubernetes Kubelet... Jun 10 15:01:39.065678 ip-10-0-141-243 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 15:01:39.065678 ip-10-0-141-243 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 15:01:39.065678 ip-10-0-141-243 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 15:01:39.065678 ip-10-0-141-243 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 15:01:39.065678 ip-10-0-141-243 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 15:01:39.067415 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.067296 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 15:01:39.070729 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070713 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.070729 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070729 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070733 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070736 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070739 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070744 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070746 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070749 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070751 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070754 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070757 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070760 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070762 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070765 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070769 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070772 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070775 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070777 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070780 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070783 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070785 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.070794 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070788 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070791 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070794 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070796 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070799 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070803 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070807 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070810 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070812 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070817 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070820 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070823 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070826 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070829 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070832 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070834 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070837 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070839 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070842 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.071274 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070844 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070847 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070849 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070852 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070855 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070857 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070860 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070863 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070865 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070868 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070870 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070873 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070875 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070878 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070881 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070885 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070888 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070891 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070893 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070896 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.071752 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070899 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070901 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070904 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070906 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070909 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070911 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070914 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070916 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070919 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070921 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070924 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070926 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070928 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070931 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070933 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070936 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070939 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070941 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070945 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070947 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.072241 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070950 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070952 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070955 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070957 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070960 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070962 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070965 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070971 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070975 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070978 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070988 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070992 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070994 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.070997 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071000 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071003 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071005 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071007 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071010 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.072741 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071713 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071720 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071723 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071726 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071729 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071732 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071734 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071737 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071739 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071742 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071745 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071748 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071750 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071753 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071756 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071759 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071761 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071764 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071766 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.073204 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071769 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071773 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071777 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071780 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071782 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071787 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071791 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071794 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071797 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071799 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071802 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071805 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071808 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071810 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071813 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071815 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071817 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071820 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071822 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.073844 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071826 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071830 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071832 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071835 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071837 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071840 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071842 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071846 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071848 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071851 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071853 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071856 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071858 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071861 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071865 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071867 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071870 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071873 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071877 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071881 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.074476 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071883 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071886 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071889 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071891 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071895 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071898 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071901 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071903 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071906 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071909 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071912 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071914 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071918 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071920 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071923 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071925 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071928 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071931 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071933 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071936 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.074995 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071939 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071941 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071943 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071946 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071948 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071951 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071955 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071958 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071960 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071963 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071966 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071968 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071971 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071973 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071976 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071978 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071981 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071983 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071985 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071988 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.075480 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.071991 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072364 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072369 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072372 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072374 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072377 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072381 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072385 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072388 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072391 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072393 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072396 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072398 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072401 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072404 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072407 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072409 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072413 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072416 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.076049 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072419 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072421 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072424 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072427 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072430 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072433 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072435 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072438 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072440 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072443 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072445 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072449 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072452 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072456 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072458 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072462 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072465 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072468 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072470 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072474 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.076755 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072476 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072478 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072481 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072483 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072486 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072489 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072491 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072494 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072496 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072502 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072505 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072508 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072510 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072513 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072515 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072518 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072521 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072523 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072526 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072528 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.077430 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072531 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072533 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072536 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072538 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072542 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072545 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072547 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072550 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072553 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072570 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072574 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072578 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072581 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072583 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072586 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072589 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072591 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072593 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072596 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.078117 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072599 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072601 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072606 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072608 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072611 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072614 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072616 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072619 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072622 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072625 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072627 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072631 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072633 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072636 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072639 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072641 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072644 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072646 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072649 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072651 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.078715 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072668 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.072671 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072745 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072752 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072758 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072763 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072767 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072770 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072774 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072778 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072782 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072785 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072789 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072792 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072796 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072800 2573 flags.go:64] FLAG: --cgroup-root="" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072803 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072806 2573 flags.go:64] FLAG: --client-ca-file="" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072809 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072812 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072817 2573 flags.go:64] FLAG: --cluster-domain="" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072819 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072823 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072826 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 15:01:39.079216 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072829 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072833 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072836 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072839 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072842 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072845 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072848 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072851 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072854 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072857 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072861 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072864 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072867 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072870 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072872 2573 flags.go:64] FLAG: --enable-server="true" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072875 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072880 2573 flags.go:64] FLAG: --event-burst="100" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072883 2573 flags.go:64] FLAG: --event-qps="50" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072886 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072889 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072892 2573 flags.go:64] FLAG: --eviction-hard="" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072895 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072899 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072904 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072907 2573 flags.go:64] FLAG: --eviction-soft="" Jun 10 15:01:39.079945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072910 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072913 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072915 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072918 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072921 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072924 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072927 2573 flags.go:64] FLAG: --feature-gates="" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072931 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072933 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072936 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072940 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072943 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072946 2573 flags.go:64] FLAG: --help="false" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072949 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072952 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072955 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072958 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072961 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072965 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072968 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072970 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072973 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072976 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 15:01:39.080608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072979 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072982 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072985 2573 flags.go:64] FLAG: --kube-reserved="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072988 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072991 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072994 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.072997 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073001 2573 flags.go:64] FLAG: --lock-file="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073004 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073007 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073010 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073016 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073019 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073021 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073024 2573 flags.go:64] FLAG: --logging-format="text" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073027 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073031 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073034 2573 flags.go:64] FLAG: --manifest-url="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073037 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073041 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073044 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073048 2573 flags.go:64] FLAG: --max-pods="110" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073051 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073054 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073057 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 15:01:39.081197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073060 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073063 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073066 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073069 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073075 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073079 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073082 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073084 2573 flags.go:64] FLAG: --pod-cidr="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073087 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073093 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073095 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073098 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073101 2573 flags.go:64] FLAG: --port="10250" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073104 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073108 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08330ff3dfea9b92e" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073111 2573 flags.go:64] FLAG: --qos-reserved="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073114 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073117 2573 flags.go:64] FLAG: --register-node="true" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073119 2573 flags.go:64] FLAG: --register-with-taints="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073123 2573 flags.go:64] FLAG: --registry-burst="10" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073126 2573 flags.go:64] FLAG: --registry-qps="5" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073128 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073131 2573 flags.go:64] FLAG: --reserved-memory="" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073135 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073138 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 15:01:39.081826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073141 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073144 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073147 2573 flags.go:64] FLAG: --runonce="false" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073149 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073152 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073155 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073158 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073160 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073163 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073166 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073169 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073174 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073177 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073179 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073182 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073185 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073188 2573 flags.go:64] FLAG: --system-cgroups="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073191 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073196 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073199 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073202 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073207 2573 flags.go:64] FLAG: --tls-min-version="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073210 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073213 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073216 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 15:01:39.082534 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073219 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073222 2573 flags.go:64] FLAG: --v="2" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073226 2573 flags.go:64] FLAG: --version="false" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073230 2573 flags.go:64] FLAG: --vmodule="" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073233 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.073237 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.075842 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.075910 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076048 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076054 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076059 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076063 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076068 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076073 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076077 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076082 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076086 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076091 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076095 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076099 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076106 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.083180 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076110 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076115 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076119 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076124 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076128 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076133 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076137 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076142 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076147 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076151 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076155 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076159 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076164 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076169 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076173 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076178 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076182 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076187 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076191 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076197 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.083718 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076201 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076206 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076211 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076215 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076220 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076224 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076228 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076233 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076237 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076242 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076246 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076254 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076261 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076266 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076270 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076274 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076279 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076283 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076288 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076293 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.084236 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076298 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076302 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076306 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076310 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076317 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076322 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076326 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076331 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076336 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076341 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076346 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076352 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076356 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076361 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076365 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076370 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076374 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076379 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076383 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.084744 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076388 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076392 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076396 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076400 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076404 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076408 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076412 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076416 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076421 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076425 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076430 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076435 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076440 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076444 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076448 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076452 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076456 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076460 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076464 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076469 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.085250 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076473 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076477 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076481 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076485 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.076489 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.077055 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.083937 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.083956 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.083976 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.083982 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084045 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084050 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084054 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084056 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084059 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.085766 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084063 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084065 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084068 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084071 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084073 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084078 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084081 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084084 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084088 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084091 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084094 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084096 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084099 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084102 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084105 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084108 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084110 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084113 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084115 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.086137 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084118 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084121 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084123 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084126 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084129 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084133 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084136 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084138 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084141 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084144 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084146 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084149 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084152 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084154 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084157 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084159 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084162 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084165 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084167 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084170 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.086614 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084172 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084174 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084177 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084180 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084182 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084185 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084187 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084190 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084192 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084195 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084197 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084200 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084203 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084206 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084209 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084211 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084213 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084217 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084221 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084224 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.087108 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084226 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084229 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084232 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084234 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084236 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084239 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084242 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084244 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084247 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084250 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084253 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084255 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084258 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084260 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084263 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084266 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084268 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084271 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084273 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084276 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.087612 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084278 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084282 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084285 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084288 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084292 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084295 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084299 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084301 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084305 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084308 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084311 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084314 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084317 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084319 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.088090 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084323 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.084328 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084465 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084470 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084473 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084477 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084480 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084483 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084486 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084488 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084491 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084494 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084497 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084500 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 15:01:39.088441 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084504 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084507 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084510 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084513 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084516 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084519 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084522 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084524 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084527 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084529 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084532 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084535 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084537 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084540 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084543 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084546 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084549 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084552 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084554 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084574 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 15:01:39.088885 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084577 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084580 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084582 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084585 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084588 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084590 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084593 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084595 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084598 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084601 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084603 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084606 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084608 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084611 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084613 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084616 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084619 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084624 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084627 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 15:01:39.089357 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084630 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084632 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084635 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084637 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084640 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084643 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084645 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084648 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084651 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084654 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084657 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084660 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084662 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084666 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084669 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084673 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084675 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084678 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084681 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 15:01:39.089845 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084684 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084686 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084689 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084691 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084693 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084696 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084699 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084701 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084704 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084706 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084709 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084711 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084714 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084716 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084719 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084721 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084724 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084726 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084729 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084732 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 15:01:39.090302 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084734 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084737 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084740 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084742 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084745 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084748 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084751 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084753 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:39.084756 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.084761 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.084868 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.086792 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.088178 2573 server.go:1019] "Starting client certificate rotation" Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.088278 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 15:01:39.090824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.089073 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 15:01:39.091187 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.090763 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 15:01:39.094098 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.094069 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 15:01:39.102923 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.102905 2573 log.go:25] "Validated CRI v1 runtime API" Jun 10 15:01:39.106372 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.106344 2573 log.go:25] "Validated CRI v1 image API" Jun 10 15:01:39.108081 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.108059 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 15:01:39.110717 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.110693 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88963214-8d55-47fa-b1ed-a078a7e73949:/dev/nvme0n1p3 99e342b9-9be5-49f5-a07d-8fdcba4fc18d:/dev/nvme0n1p4] Jun 10 15:01:39.110786 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.110717 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 15:01:39.115655 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.115526 2573 manager.go:216] Machine: {Timestamp:2026-06-10 15:01:39.114364896 +0000 UTC m=+0.332131489 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096427 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244142aaac109800d310fe7be3fdca SystemUUID:ec244142-aaac-1098-00d3-10fe7be3fdca BootID:023f4610-51bd-451c-9ac8-12eee9e9cc6f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:c5:84:be:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:c5:84:be:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:e2:4e:e9:07:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 15:01:39.115655 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.115653 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 15:01:39.115763 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.115733 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 15:01:39.119101 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.119075 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 15:01:39.119246 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.119104 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 15:01:39.119879 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.119864 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 15:01:39.119914 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.119887 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 15:01:39.119914 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.119897 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 15:01:39.120846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.120834 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 15:01:39.121621 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.121611 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 15:01:39.122987 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.122962 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 15:01:39.124648 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124636 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 10 15:01:39.124807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124796 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 15:01:39.124847 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124827 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 10 15:01:39.124847 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124838 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 15:01:39.124935 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124861 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 15:01:39.124935 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124873 2573 kubelet.go:398] "Adding apiserver pod source" Jun 10 15:01:39.124935 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.124882 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 15:01:39.125241 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.125228 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 15:01:39.125303 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.125246 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 15:01:39.127703 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.127688 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 15:01:39.128976 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.128963 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 15:01:39.129021 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.128993 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 15:01:39.130081 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130069 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 15:01:39.130117 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130087 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 15:01:39.130117 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130096 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 15:01:39.130117 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130105 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 15:01:39.130117 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130115 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130122 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130131 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130136 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130148 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130154 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130166 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 15:01:39.130225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.130172 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 15:01:39.131766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.131755 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 15:01:39.131807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.131769 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 15:01:39.135508 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.135490 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 15:01:39.135674 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.135658 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 15:01:39.135933 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.135922 2573 server.go:1268] "Started kubelet" Jun 10 15:01:39.135980 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.135941 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 15:01:39.136054 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.136031 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 15:01:39.136086 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.136030 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 15:01:39.136118 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.136089 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 15:01:39.136867 ip-10-0-141-243 systemd[1]: Started Kubernetes Kubelet. Jun 10 15:01:39.137451 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.137134 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 10 15:01:39.137633 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.137616 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 15:01:39.143127 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.143103 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 15:01:39.145058 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145040 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 15:01:39.145058 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145040 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 15:01:39.145181 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.145165 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.145546 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.144434 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-243.ec2.internal.18b7c060af2131b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-243.ec2.internal,UID:ip-10-0-141-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-243.ec2.internal,},FirstTimestamp:2026-06-10 15:01:39.135902135 +0000 UTC m=+0.353668727,LastTimestamp:2026-06-10 15:01:39.135902135 +0000 UTC m=+0.353668727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-243.ec2.internal,}" Jun 10 15:01:39.145686 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145668 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 15:01:39.145783 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145759 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 15:01:39.145783 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145669 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 15:01:39.145869 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145835 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 10 15:01:39.145869 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.145843 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 10 15:01:39.146215 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146200 2573 factory.go:55] Registering systemd factory Jun 10 15:01:39.146281 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146224 2573 factory.go:223] Registration of the systemd container factory successfully Jun 10 15:01:39.146409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146396 2573 factory.go:153] Registering CRI-O factory Jun 10 15:01:39.146409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146410 2573 factory.go:223] Registration of the crio container factory successfully Jun 10 15:01:39.146494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146456 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 15:01:39.146494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146481 2573 factory.go:103] Registering Raw factory Jun 10 15:01:39.146494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.146492 2573 manager.go:1196] Started watching for new ooms in manager Jun 10 15:01:39.147136 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.147086 2573 manager.go:349] Starting recovery of all containers Jun 10 15:01:39.147244 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.147227 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqf52" Jun 10 15:01:39.153884 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.153860 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 15:01:39.153969 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.153870 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 15:01:39.154110 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.154068 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 15:01:39.154292 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.154272 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqf52" Jun 10 15:01:39.156510 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.156490 2573 manager.go:354] Recovery completed Jun 10 15:01:39.161207 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.161105 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.164914 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.164897 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.164981 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.164930 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.164981 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.164943 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.165424 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.165410 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 15:01:39.165475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.165426 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 15:01:39.165475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.165444 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 10 15:01:39.165475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.165455 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.166517 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166503 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.166612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166518 2573 policy_none.go:49] "None policy: Start" Jun 10 15:01:39.166612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166529 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.166612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166530 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 15:01:39.166612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166539 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.166612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.166549 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 15:01:39.167611 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.167599 2573 policy_none.go:47] "Start" Jun 10 15:01:39.208178 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208160 2573 manager.go:337] "Starting Device Plugin manager" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.208202 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208212 2573 server.go:87] "Starting device plugin registration server" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208466 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208480 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208544 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208643 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.208651 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.209178 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.209220 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.217070 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.217107 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.217141 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 15:01:39.218736 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.217175 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 15:01:39.219513 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.219496 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:39.309038 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.309014 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.310073 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.310054 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.310189 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.310089 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.310189 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.310102 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.310189 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.310125 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.318226 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.318180 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal"] Jun 10 15:01:39.318289 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.318239 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.319665 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.319641 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.319769 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.319674 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.319769 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.319687 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.320862 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.320849 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.320975 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.320960 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.321034 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.320998 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.321686 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321671 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.321774 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321696 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.321774 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321707 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.321774 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321728 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.321774 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321755 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.321774 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.321768 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.322034 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.322021 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.322068 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.322042 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-243.ec2.internal\": node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.322911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.322897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.323000 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.322927 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 15:01:39.323609 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.323591 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientMemory" Jun 10 15:01:39.323695 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.323620 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 15:01:39.323695 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.323634 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeHasSufficientPID" Jun 10 15:01:39.347890 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.347868 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/899d8cea7ff9ac33cfb934b9827471f2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-243.ec2.internal\" (UID: \"899d8cea7ff9ac33cfb934b9827471f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.348010 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.347894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.348010 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.347914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.351220 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.351203 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-243.ec2.internal\" not found" node="ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.355697 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.355678 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-243.ec2.internal\" not found" node="ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.356851 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.356837 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.448964 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.448933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/899d8cea7ff9ac33cfb934b9827471f2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-243.ec2.internal\" (UID: \"899d8cea7ff9ac33cfb934b9827471f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.448964 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.448964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.449150 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.448981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.449150 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.449030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.449150 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.449034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/899d8cea7ff9ac33cfb934b9827471f2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-243.ec2.internal\" (UID: \"899d8cea7ff9ac33cfb934b9827471f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.449150 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.449071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64027708399682e5a2d5b63e1d6e30bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal\" (UID: \"64027708399682e5a2d5b63e1d6e30bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.457048 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.457023 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.557998 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.557970 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.654899 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.654824 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.658420 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.658314 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.659471 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:39.659449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:39.758408 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.758364 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.858963 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.858934 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:39.959500 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:39.959417 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:40.050529 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.050505 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:40.060316 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:40.060294 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:40.087487 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.087464 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 15:01:40.088078 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.087628 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 15:01:40.088078 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.087634 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 15:01:40.156926 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.156883 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 14:56:39 +0000 UTC" deadline="2028-01-09 02:34:57.836536509 +0000 UTC" Jun 10 15:01:40.156926 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.156919 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13859h33m17.679622794s" Jun 10 15:01:40.160384 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:40.160363 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-243.ec2.internal\" not found" Jun 10 15:01:40.160487 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:40.160382 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64027708399682e5a2d5b63e1d6e30bd.slice/crio-f862106c5a4850e389dd2966a940c3dd993a1298a985933f01cf30c809914ac7 WatchSource:0}: Error finding container f862106c5a4850e389dd2966a940c3dd993a1298a985933f01cf30c809914ac7: Status 404 returned error can't find the container with id f862106c5a4850e389dd2966a940c3dd993a1298a985933f01cf30c809914ac7 Jun 10 15:01:40.160637 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:40.160622 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899d8cea7ff9ac33cfb934b9827471f2.slice/crio-0031b26ec66ebcac4fc7319e12b97c9588dd4f1f68be613ac7e309deb56c2afb WatchSource:0}: Error finding container 0031b26ec66ebcac4fc7319e12b97c9588dd4f1f68be613ac7e309deb56c2afb: Status 404 returned error can't find the container with id 0031b26ec66ebcac4fc7319e12b97c9588dd4f1f68be613ac7e309deb56c2afb Jun 10 15:01:40.166288 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.166274 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:01:40.188018 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.188000 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:40.219944 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.219868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" event={"ID":"899d8cea7ff9ac33cfb934b9827471f2","Type":"ContainerStarted","Data":"0031b26ec66ebcac4fc7319e12b97c9588dd4f1f68be613ac7e309deb56c2afb"} Jun 10 15:01:40.221727 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.221708 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" event={"ID":"64027708399682e5a2d5b63e1d6e30bd","Type":"ContainerStarted","Data":"f862106c5a4850e389dd2966a940c3dd993a1298a985933f01cf30c809914ac7"} Jun 10 15:01:40.245909 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.245880 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" Jun 10 15:01:40.279911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.279888 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 15:01:40.280947 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.280935 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" Jun 10 15:01:40.302317 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.302297 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 15:01:40.577102 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:40.577073 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:41.126719 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.126689 2573 apiserver.go:52] "Watching apiserver" Jun 10 15:01:41.133826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.133797 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 15:01:41.134637 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.134597 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-k74jx","openshift-image-registry/node-ca-vrg5n","openshift-multus/multus-whp5p","openshift-network-diagnostics/network-check-target-bnt86","kube-system/global-pull-secret-syncer-zlkxx","kube-system/konnectivity-agent-l8n28","kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-mp8pr","openshift-multus/network-metrics-daemon-nkzl6","openshift-network-operator/iptables-alerter-vhdjk","openshift-ovn-kubernetes/ovnkube-node-vw9bd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df","openshift-cluster-node-tuning-operator/tuned-jwf6d"] Jun 10 15:01:41.136158 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.136137 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.136273 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.136219 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:41.137375 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.137354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.138614 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.138589 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.139771 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.139748 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:41.139866 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.139819 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:41.140266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.140242 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 15:01:41.140833 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.140814 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.140942 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.140870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7lxdf\"" Jun 10 15:01:41.140942 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.140911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.141026 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.140966 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:41.142332 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.142241 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.142793 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.142776 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.143056 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143031 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 15:01:41.143164 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 15:01:41.143306 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143276 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5g74s\"" Jun 10 15:01:41.143642 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143623 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.143771 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.143967 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.143894 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.144432 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.144416 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 15:01:41.144531 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.144509 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cwnm5\"" Jun 10 15:01:41.145053 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.145034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.146218 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.146200 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 15:01:41.146356 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.146340 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.146882 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.146492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 15:01:41.146882 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.146624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-csb6l\"" Jun 10 15:01:41.147030 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147007 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ldp6d\"" Jun 10 15:01:41.147095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147078 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 15:01:41.147357 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147341 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.147357 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147352 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 15:01:41.147841 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147819 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.148073 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.147988 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.149395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.149377 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.149487 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.149447 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.150407 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.150388 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.150496 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.150430 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 15:01:41.150571 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.150433 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fthqm\"" Jun 10 15:01:41.150963 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.150947 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.151324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151304 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.151324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151324 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.151456 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151333 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.151456 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151453 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.151756 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151735 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nqcwb\"" Jun 10 15:01:41.151756 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151754 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7j6mq\"" Jun 10 15:01:41.151916 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.151766 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 15:01:41.152813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.152788 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hgzgs\"" Jun 10 15:01:41.153458 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.153214 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 15:01:41.153748 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.153732 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 15:01:41.154009 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.153993 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 15:01:41.154221 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.154207 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 15:01:41.154912 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.154895 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 15:01:41.156606 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.156588 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 15:01:41.158304 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158288 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 15:01:41.158394 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-kubernetes\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.158394 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.158394 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-system-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158423 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-cni-binary-copy\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158453 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-socket-dir-parent\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysconfig\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-run\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-kubelet-config\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.158553 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-dbus\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4x8\" (UniqueName: \"kubernetes.io/projected/7c00685c-08a3-429f-8db7-818dd3041b38-kube-api-access-rl4x8\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdvv\" (UniqueName: \"kubernetes.io/projected/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-kube-api-access-7hdvv\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-k8s-cni-cncf-io\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5pn\" (UniqueName: \"kubernetes.io/projected/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-kube-api-access-wn5pn\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:41.158846 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-lib-modules\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-socket-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-registration-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-os-release\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-host\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cnibin\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.158978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-tmp\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed76c00-1394-41dd-aed4-85f6abec6498-agent-certs\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-bin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-conf\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-var-lib-kubelet\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-tuned\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159205 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tw8g\" (UniqueName: \"kubernetes.io/projected/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-kube-api-access-2tw8g\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-serviceca\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76c00-1394-41dd-aed4-85f6abec6498-konnectivity-ca\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-cnibin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-kubelet\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-daemon-config\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj2k\" (UniqueName: \"kubernetes.io/projected/8ac8bebb-df55-4cc7-84ca-3be8761815c7-kube-api-access-dbj2k\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159487 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-os-release\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsq8\" (UniqueName: \"kubernetes.io/projected/8aa17a30-90ce-426a-8778-62b20abcbe81-kube-api-access-trsq8\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159531 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-modprobe-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-host\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-sys-fs\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.159747 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-multus\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-conf-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-systemd\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-device-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-netns\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-multus-certs\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-hostroot\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-sys\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.160600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.159912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-etc-kubernetes\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.182715 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.182695 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v2s8" Jun 10 15:01:41.191737 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.191714 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v2s8" Jun 10 15:01:41.246649 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.246619 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 15:01:41.260730 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260703 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.260730 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260749 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-cnibin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-kubelet\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-daemon-config\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj2k\" (UniqueName: \"kubernetes.io/projected/8ac8bebb-df55-4cc7-84ca-3be8761815c7-kube-api-access-dbj2k\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-cnibin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-system-cni-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-os-release\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.260911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsq8\" (UniqueName: \"kubernetes.io/projected/8aa17a30-90ce-426a-8778-62b20abcbe81-kube-api-access-trsq8\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-modprobe-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-os-release\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-host\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.260979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-sys-fs\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-sys-fs\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-host\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-kubelet\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261089 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-modprobe-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-multus\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-conf-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261201 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-multus\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-systemd\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-conf-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-device-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-iptables-alerter-script\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.261392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-systemd\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.261310 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-device-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.261396 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:41.761377926 +0000 UTC m=+2.979144515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-node-log\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-netns\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-multus-certs\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-multus-certs\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-ovn\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-netns\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22bxw\" (UniqueName: \"kubernetes.io/projected/0d3f62e6-b211-4021-a728-2d052202951e-kube-api-access-22bxw\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-hostroot\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-daemon-config\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-sys\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.262065 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261652 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-hostroot\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvb2\" (UniqueName: \"kubernetes.io/projected/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-kube-api-access-wnvb2\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-etc-kubernetes\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-kubernetes\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-sys\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-host-slash\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-kubernetes\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-etc-kubernetes\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261779 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261788 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-system-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-cni-binary-copy\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-socket-dir-parent\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.261953 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-system-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.261975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-socket-dir-parent\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.262844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysconfig\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.262016 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:01:41.761999737 +0000 UTC m=+2.979766321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysconfig\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-run\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-script-lib\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-kubelet-config\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262142 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-run\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-dbus\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d25317a-5b82-40ba-883c-6e9f08e46323-tmp-dir\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262189 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-systemd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4x8\" (UniqueName: \"kubernetes.io/projected/7c00685c-08a3-429f-8db7-818dd3041b38-kube-api-access-rl4x8\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-kubelet-config\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdvv\" (UniqueName: \"kubernetes.io/projected/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-kube-api-access-7hdvv\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-dbus\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.263570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-k8s-cni-cncf-io\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d25317a-5b82-40ba-883c-6e9f08e46323-hosts-file\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aa17a30-90ce-426a-8778-62b20abcbe81-cni-binary-copy\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262380 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-bin\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262382 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-run-k8s-cni-cncf-io\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-env-overrides\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5pn\" (UniqueName: \"kubernetes.io/projected/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-kube-api-access-wn5pn\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-systemd-units\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-var-lib-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-etc-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-config\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-lib-modules\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.264276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-socket-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-registration-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-os-release\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-slash\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-host\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cnibin\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-os-release\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262829 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-lib-modules\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-socket-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262891 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-host\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cnibin\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c00685c-08a3-429f-8db7-818dd3041b38-registration-dir\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.262880 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-kubelet\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-netd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d3f62e6-b211-4021-a728-2d052202951e-ovn-node-metrics-cert\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-tmp\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.264917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed76c00-1394-41dd-aed4-85f6abec6498-agent-certs\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-bin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-conf\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-var-lib-kubelet\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-host-var-lib-cni-bin\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-tuned\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tw8g\" (UniqueName: \"kubernetes.io/projected/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-kube-api-access-2tw8g\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-var-lib-kubelet\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-conf\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-netns\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263299 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-log-socket\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263302 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-serviceca\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aa17a30-90ce-426a-8778-62b20abcbe81-multus-cni-dir\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x9sx\" (UniqueName: \"kubernetes.io/projected/5d25317a-5b82-40ba-883c-6e9f08e46323-kube-api-access-2x9sx\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76c00-1394-41dd-aed4-85f6abec6498-konnectivity-ca\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.265395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-sysctl-d\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.265998 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263785 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-serviceca\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.265998 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.263877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76c00-1394-41dd-aed4-85f6abec6498-konnectivity-ca\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.267047 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.266685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-tmp\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.267047 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.266700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ac8bebb-df55-4cc7-84ca-3be8761815c7-etc-tuned\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.267193 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.267126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ed76c00-1394-41dd-aed4-85f6abec6498-agent-certs\") pod \"konnectivity-agent-l8n28\" (UID: \"3ed76c00-1394-41dd-aed4-85f6abec6498\") " pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.273437 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.273413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsq8\" (UniqueName: \"kubernetes.io/projected/8aa17a30-90ce-426a-8778-62b20abcbe81-kube-api-access-trsq8\") pod \"multus-whp5p\" (UID: \"8aa17a30-90ce-426a-8778-62b20abcbe81\") " pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.273541 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.273415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdvv\" (UniqueName: \"kubernetes.io/projected/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-kube-api-access-7hdvv\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.273810 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.273795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj2k\" (UniqueName: \"kubernetes.io/projected/8ac8bebb-df55-4cc7-84ca-3be8761815c7-kube-api-access-dbj2k\") pod \"tuned-jwf6d\" (UID: \"8ac8bebb-df55-4cc7-84ca-3be8761815c7\") " pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.277706 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.277680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tw8g\" (UniqueName: \"kubernetes.io/projected/7cac5aad-c80a-4d2e-b4aa-e881b8e5a380-kube-api-access-2tw8g\") pod \"node-ca-vrg5n\" (UID: \"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380\") " pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.279617 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.279597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4x8\" (UniqueName: \"kubernetes.io/projected/7c00685c-08a3-429f-8db7-818dd3041b38-kube-api-access-rl4x8\") pod \"aws-ebs-csi-driver-node-gc6df\" (UID: \"7c00685c-08a3-429f-8db7-818dd3041b38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.279702 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.279657 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:41.279702 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.279672 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:41.279702 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.279681 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:41.279802 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.279734 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:41.779721598 +0000 UTC m=+2.997488182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:41.280985 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.280963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5pn\" (UniqueName: \"kubernetes.io/projected/3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8-kube-api-access-wn5pn\") pod \"multus-additional-cni-plugins-mp8pr\" (UID: \"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8\") " pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.364594 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-host-slash\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.364594 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364618 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-host-slash\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-script-lib\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d25317a-5b82-40ba-883c-6e9f08e46323-tmp-dir\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-systemd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d25317a-5b82-40ba-883c-6e9f08e46323-hosts-file\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-bin\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-systemd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.364813 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-env-overrides\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364864 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d25317a-5b82-40ba-883c-6e9f08e46323-hosts-file\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364859 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-bin\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-systemd-units\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-var-lib-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.364964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-etc-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-systemd-units\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-var-lib-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-etc-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-config\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365087 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-slash\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-kubelet\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365121 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d25317a-5b82-40ba-883c-6e9f08e46323-tmp-dir\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365148 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-kubelet\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-slash\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-netd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d3f62e6-b211-4021-a728-2d052202951e-ovn-node-metrics-cert\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-netns\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.365315 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-cni-netd\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-log-socket\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-env-overrides\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-host-run-netns\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x9sx\" (UniqueName: \"kubernetes.io/projected/5d25317a-5b82-40ba-883c-6e9f08e46323-kube-api-access-2x9sx\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-log-socket\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-iptables-alerter-script\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-node-log\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-ovn\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-config\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22bxw\" (UniqueName: \"kubernetes.io/projected/0d3f62e6-b211-4021-a728-2d052202951e-kube-api-access-22bxw\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvb2\" (UniqueName: \"kubernetes.io/projected/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-kube-api-access-wnvb2\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-node-log\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d3f62e6-b211-4021-a728-2d052202951e-ovnkube-script-lib\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-ovn\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d3f62e6-b211-4021-a728-2d052202951e-run-openvswitch\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.366052 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.365880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-iptables-alerter-script\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.367698 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.367675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d3f62e6-b211-4021-a728-2d052202951e-ovn-node-metrics-cert\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.378492 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.378462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvb2\" (UniqueName: \"kubernetes.io/projected/4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7-kube-api-access-wnvb2\") pod \"iptables-alerter-vhdjk\" (UID: \"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7\") " pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.379190 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.379166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x9sx\" (UniqueName: \"kubernetes.io/projected/5d25317a-5b82-40ba-883c-6e9f08e46323-kube-api-access-2x9sx\") pod \"node-resolver-k74jx\" (UID: \"5d25317a-5b82-40ba-883c-6e9f08e46323\") " pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.379450 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.379435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22bxw\" (UniqueName: \"kubernetes.io/projected/0d3f62e6-b211-4021-a728-2d052202951e-kube-api-access-22bxw\") pod \"ovnkube-node-vw9bd\" (UID: \"0d3f62e6-b211-4021-a728-2d052202951e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.449571 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.449519 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" Jun 10 15:01:41.457338 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.457314 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-whp5p" Jun 10 15:01:41.464968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.464949 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:01:41.472528 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.472509 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" Jun 10 15:01:41.478150 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.478129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" Jun 10 15:01:41.484073 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.484054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vrg5n" Jun 10 15:01:41.490522 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.490497 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k74jx" Jun 10 15:01:41.497217 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.497195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhdjk" Jun 10 15:01:41.502779 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.502763 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:01:41.507706 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.507689 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:41.768126 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.768089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:41.768314 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.768133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:41.768314 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.768274 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:41.768425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.768332 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:01:42.768313839 +0000 UTC m=+3.986080419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:41.768425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.768275 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:41.768534 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.768441 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:42.768417289 +0000 UTC m=+3.986183876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:41.869029 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:41.868988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:41.869226 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.869153 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:41.869226 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.869176 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:41.869226 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.869190 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:41.869363 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:41.869269 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:42.869249004 +0000 UTC m=+4.087015603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:41.933320 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.933243 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cac5aad_c80a_4d2e_b4aa_e881b8e5a380.slice/crio-64ced583b8e1efae67b6b0793548454771ec5c39bdcd1bf3457abec8ceef9fc0 WatchSource:0}: Error finding container 64ced583b8e1efae67b6b0793548454771ec5c39bdcd1bf3457abec8ceef9fc0: Status 404 returned error can't find the container with id 64ced583b8e1efae67b6b0793548454771ec5c39bdcd1bf3457abec8ceef9fc0 Jun 10 15:01:41.934456 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.934428 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac8bebb_df55_4cc7_84ca_3be8761815c7.slice/crio-87c6f59d874ca37339380b85d75c4d3257ff9f4fe3bb3b7839342e7b27e190b3 WatchSource:0}: Error finding container 87c6f59d874ca37339380b85d75c4d3257ff9f4fe3bb3b7839342e7b27e190b3: Status 404 returned error can't find the container with id 87c6f59d874ca37339380b85d75c4d3257ff9f4fe3bb3b7839342e7b27e190b3 Jun 10 15:01:41.936328 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.936302 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d25317a_5b82_40ba_883c_6e9f08e46323.slice/crio-20b24a540f4cd49e1ba4fc165ac086aba644e51b406c84af05a874503e23a463 WatchSource:0}: Error finding container 20b24a540f4cd49e1ba4fc165ac086aba644e51b406c84af05a874503e23a463: Status 404 returned error can't find the container with id 20b24a540f4cd49e1ba4fc165ac086aba644e51b406c84af05a874503e23a463 Jun 10 15:01:41.940159 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.940132 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed76c00_1394_41dd_aed4_85f6abec6498.slice/crio-68d9d8a979f7afe1d2681c43aa5d97d1210a61ad6b99e17051d2c2f306eeb9be WatchSource:0}: Error finding container 68d9d8a979f7afe1d2681c43aa5d97d1210a61ad6b99e17051d2c2f306eeb9be: Status 404 returned error can't find the container with id 68d9d8a979f7afe1d2681c43aa5d97d1210a61ad6b99e17051d2c2f306eeb9be Jun 10 15:01:41.940879 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.940857 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3f62e6_b211_4021_a728_2d052202951e.slice/crio-7746207cbe42b14898726e5c6020841d0ebbd36749b45c3da80e4a8f78f35104 WatchSource:0}: Error finding container 7746207cbe42b14898726e5c6020841d0ebbd36749b45c3da80e4a8f78f35104: Status 404 returned error can't find the container with id 7746207cbe42b14898726e5c6020841d0ebbd36749b45c3da80e4a8f78f35104 Jun 10 15:01:41.942056 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.942032 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6fbe2a_8e3a_4e3c_8ce3_2e912674bac7.slice/crio-e9632d8fea7b087fc7994794d20e7f721f3e5390a89db6e96315c2556128ca24 WatchSource:0}: Error finding container e9632d8fea7b087fc7994794d20e7f721f3e5390a89db6e96315c2556128ca24: Status 404 returned error can't find the container with id e9632d8fea7b087fc7994794d20e7f721f3e5390a89db6e96315c2556128ca24 Jun 10 15:01:41.943606 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.943499 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c00685c_08a3_429f_8db7_818dd3041b38.slice/crio-f0aabb98901296b702c20506dbf90065e0adaed2a1259d754cbdc6991762fcaa WatchSource:0}: Error finding container f0aabb98901296b702c20506dbf90065e0adaed2a1259d754cbdc6991762fcaa: Status 404 returned error can't find the container with id f0aabb98901296b702c20506dbf90065e0adaed2a1259d754cbdc6991762fcaa Jun 10 15:01:41.944434 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.944196 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e514aed_ba6b_4972_b7ea_0e0e2fbf32a8.slice/crio-3983c50b462a5f4fdd9380945e2353e2359a725e0e0345e4e3f4887b6a7dd6d3 WatchSource:0}: Error finding container 3983c50b462a5f4fdd9380945e2353e2359a725e0e0345e4e3f4887b6a7dd6d3: Status 404 returned error can't find the container with id 3983c50b462a5f4fdd9380945e2353e2359a725e0e0345e4e3f4887b6a7dd6d3 Jun 10 15:01:41.945214 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:01:41.945031 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa17a30_90ce_426a_8778_62b20abcbe81.slice/crio-3afa26dd43e2202fffee21f814031a4199b4da552b420876ae9cbe0f80b9d7ad WatchSource:0}: Error finding container 3afa26dd43e2202fffee21f814031a4199b4da552b420876ae9cbe0f80b9d7ad: Status 404 returned error can't find the container with id 3afa26dd43e2202fffee21f814031a4199b4da552b420876ae9cbe0f80b9d7ad Jun 10 15:01:42.195100 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.194936 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:56:41 +0000 UTC" deadline="2028-01-12 05:57:22.824907287 +0000 UTC" Jun 10 15:01:42.195100 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.195098 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13934h55m40.62981214s" Jun 10 15:01:42.217808 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.217774 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:42.217942 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.217908 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:42.227682 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.227651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" event={"ID":"899d8cea7ff9ac33cfb934b9827471f2","Type":"ContainerStarted","Data":"755b4601668c71b16d5ffb09764abf5a3eb7924f9b52fe9915a6c2c1f0dee21f"} Jun 10 15:01:42.228987 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.228950 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l8n28" event={"ID":"3ed76c00-1394-41dd-aed4-85f6abec6498","Type":"ContainerStarted","Data":"68d9d8a979f7afe1d2681c43aa5d97d1210a61ad6b99e17051d2c2f306eeb9be"} Jun 10 15:01:42.230184 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.230133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrg5n" event={"ID":"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380","Type":"ContainerStarted","Data":"64ced583b8e1efae67b6b0793548454771ec5c39bdcd1bf3457abec8ceef9fc0"} Jun 10 15:01:42.232144 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.232111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" event={"ID":"64027708399682e5a2d5b63e1d6e30bd","Type":"ContainerStarted","Data":"76c334c564bad04545524bd5b8f36bab6a4d0065e61f55b6349aebaa1c469ad2"} Jun 10 15:01:42.233704 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.233661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-whp5p" event={"ID":"8aa17a30-90ce-426a-8778-62b20abcbe81","Type":"ContainerStarted","Data":"3afa26dd43e2202fffee21f814031a4199b4da552b420876ae9cbe0f80b9d7ad"} Jun 10 15:01:42.234888 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.234866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerStarted","Data":"3983c50b462a5f4fdd9380945e2353e2359a725e0e0345e4e3f4887b6a7dd6d3"} Jun 10 15:01:42.236157 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.236136 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" event={"ID":"7c00685c-08a3-429f-8db7-818dd3041b38","Type":"ContainerStarted","Data":"f0aabb98901296b702c20506dbf90065e0adaed2a1259d754cbdc6991762fcaa"} Jun 10 15:01:42.237522 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.237502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhdjk" event={"ID":"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7","Type":"ContainerStarted","Data":"e9632d8fea7b087fc7994794d20e7f721f3e5390a89db6e96315c2556128ca24"} Jun 10 15:01:42.238937 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.238918 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"7746207cbe42b14898726e5c6020841d0ebbd36749b45c3da80e4a8f78f35104"} Jun 10 15:01:42.240131 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.240112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k74jx" event={"ID":"5d25317a-5b82-40ba-883c-6e9f08e46323","Type":"ContainerStarted","Data":"20b24a540f4cd49e1ba4fc165ac086aba644e51b406c84af05a874503e23a463"} Jun 10 15:01:42.241434 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.241406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" event={"ID":"8ac8bebb-df55-4cc7-84ca-3be8761815c7","Type":"ContainerStarted","Data":"87c6f59d874ca37339380b85d75c4d3257ff9f4fe3bb3b7839342e7b27e190b3"} Jun 10 15:01:42.246576 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.244043 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-243.ec2.internal" podStartSLOduration=2.244027744 podStartE2EDuration="2.244027744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:01:42.24368644 +0000 UTC m=+3.461453038" watchObservedRunningTime="2026-06-10 15:01:42.244027744 +0000 UTC m=+3.461794348" Jun 10 15:01:42.604304 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.603980 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.778372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.778459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.778595 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.778656 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:44.778638414 +0000 UTC m=+5.996405010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.779049 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:42.779132 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.779097 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:01:44.779083279 +0000 UTC m=+5.996849863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:42.879754 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:42.879092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:42.879754 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.879258 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:42.879754 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.879276 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:42.879754 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.879289 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:42.879754 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:42.879348 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:44.879328208 +0000 UTC m=+6.097094807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:43.199623 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.195451 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 14:56:41 +0000 UTC" deadline="2028-02-14 11:33:52.033988 +0000 UTC" Jun 10 15:01:43.199623 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.195510 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14732h32m8.838483177s" Jun 10 15:01:43.220593 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.220547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:43.220759 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:43.220706 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:43.220759 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.220729 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:43.220878 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:43.220828 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:43.262103 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.260994 2573 generic.go:356] "Generic (PLEG): container finished" podID="64027708399682e5a2d5b63e1d6e30bd" containerID="76c334c564bad04545524bd5b8f36bab6a4d0065e61f55b6349aebaa1c469ad2" exitCode=0 Jun 10 15:01:43.262103 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.261625 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" event={"ID":"64027708399682e5a2d5b63e1d6e30bd","Type":"ContainerDied","Data":"76c334c564bad04545524bd5b8f36bab6a4d0065e61f55b6349aebaa1c469ad2"} Jun 10 15:01:43.262103 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:43.261712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" event={"ID":"64027708399682e5a2d5b63e1d6e30bd","Type":"ContainerStarted","Data":"cf2a5c68df3eab3b907f08a5767167284a0a6c9cd325d603193b0c3caee01b8c"} Jun 10 15:01:44.218089 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:44.217608 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:44.218089 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.217746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:44.798797 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:44.798758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:44.798976 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:44.798825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:44.798976 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.798961 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:44.799108 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.799029 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:01:48.799010616 +0000 UTC m=+10.016777200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:44.799449 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.799432 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:44.799532 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.799482 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:48.799468304 +0000 UTC m=+10.017234890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:44.899862 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:44.899823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:44.900035 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.900008 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:44.900035 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.900029 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:44.900139 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.900043 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:44.900139 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:44.900102 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:48.900083761 +0000 UTC m=+10.117850347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:45.220331 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:45.218695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:45.220331 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:45.218837 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:45.220331 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:45.219192 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:45.220331 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:45.219280 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:46.217956 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:46.217921 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:46.218135 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:46.218055 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:47.217795 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:47.217756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:47.218255 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:47.217913 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:47.218255 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:47.217926 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:47.218255 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:47.218001 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:48.217991 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:48.217879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:48.218471 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.218016 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:48.833664 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:48.833626 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:48.833854 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:48.833684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:48.833854 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.833798 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:48.833854 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.833800 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:48.834002 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.833860 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:01:56.83384079 +0000 UTC m=+18.051607372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:48.834002 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.833877 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:56.833869253 +0000 UTC m=+18.051635834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:48.934998 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:48.934903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:48.935174 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.935070 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:48.935174 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.935090 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:48.935174 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.935103 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:48.935174 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:48.935163 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:01:56.935145095 +0000 UTC m=+18.152911680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:49.219625 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:49.219107 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:49.219625 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:49.219217 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:49.220122 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:49.219860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:49.220122 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:49.219963 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:50.217626 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:50.217587 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:50.217783 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:50.217735 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:51.218069 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:51.217993 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:51.218707 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:51.218140 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:51.218707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:51.218195 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:51.218707 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:51.218300 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:52.217898 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:52.217861 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:52.218088 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:52.217994 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:53.217819 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:53.217791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:53.218010 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:53.217791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:53.218010 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:53.217913 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:53.218010 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:53.217968 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:54.217508 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:54.217481 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:54.217705 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:54.217597 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:55.217400 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:55.217364 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:55.217926 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:55.217418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:55.217926 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:55.217519 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:55.217926 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:55.217665 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:56.217775 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:56.217735 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:56.218228 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.217851 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:56.893185 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:56.893148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:56.893425 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:56.893234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:56.893425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.893280 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:56.893425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.893335 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:56.893425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.893358 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:02:12.893338558 +0000 UTC m=+34.111105145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:01:56.893425 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.893387 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:12.893371742 +0000 UTC m=+34.111138336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:01:56.994093 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:56.994057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:56.994276 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.994246 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:01:56.994276 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.994270 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:01:56.994386 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.994284 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:56.994386 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:56.994348 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:12.994329549 +0000 UTC m=+34.212096144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:01:57.218246 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:57.218159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:57.218712 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:57.218170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:57.218712 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:57.218302 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:01:57.218712 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:57.218401 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:58.217901 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:58.217867 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:01:58.218088 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:58.217982 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:01:59.218988 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:59.218946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:01:59.218988 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:01:59.218989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:01:59.219457 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:59.219072 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:01:59.219457 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:01:59.219180 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:00.217600 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:00.217569 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:00.217851 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:00.217675 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:01.219219 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.218819 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:01.219979 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.218841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:01.219979 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:01.219348 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:01.219979 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:01.219424 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:01.304906 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.304868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-whp5p" event={"ID":"8aa17a30-90ce-426a-8778-62b20abcbe81","Type":"ContainerStarted","Data":"24907bca48db44781c0e9e431187a7eee749069f286ecaa53390546720748a26"} Jun 10 15:02:01.306241 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.306219 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="319a6c5764db6bcc1a9f2aa24f4015fe006888ae95eea613f9d01b52722b4bab" exitCode=0 Jun 10 15:02:01.306337 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.306248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"319a6c5764db6bcc1a9f2aa24f4015fe006888ae95eea613f9d01b52722b4bab"} Jun 10 15:02:01.307689 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.307669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" event={"ID":"7c00685c-08a3-429f-8db7-818dd3041b38","Type":"ContainerStarted","Data":"8d4b2c7415a696049e0ea0e9f21e8f81ab87e1d87b8d9f3e0cf5693f2e4fe625"} Jun 10 15:02:01.310141 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.310115 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"a404d05c59609fbe835c5eedf0a560a975472b0ae656214df4b9ea6cb9832099"} Jun 10 15:02:01.310233 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.310190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"e27e0bdc949e3a6fe296351af2609b6f14c794fa5694a19d6692bcac15a11fe0"} Jun 10 15:02:01.310233 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.310229 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"cca1fe37b54d99c97134eaa9c0e346924beea6dfce3217057331da7aaf97ede8"} Jun 10 15:02:01.310331 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.310268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"ade3b8670d8074a9d15f5e4c364a31361428d9b308736177024c1bcba2ffce83"} Jun 10 15:02:01.311493 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.311473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k74jx" event={"ID":"5d25317a-5b82-40ba-883c-6e9f08e46323","Type":"ContainerStarted","Data":"a8013eca235ba41e51195f86ff9563ee6132d32ff709d029c8121d133f05470b"} Jun 10 15:02:01.312852 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.312834 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" event={"ID":"8ac8bebb-df55-4cc7-84ca-3be8761815c7","Type":"ContainerStarted","Data":"6930836195a6366528d384163c2bedff72759aa71988131260b5626a8e66dfc5"} Jun 10 15:02:01.314255 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.314215 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l8n28" event={"ID":"3ed76c00-1394-41dd-aed4-85f6abec6498","Type":"ContainerStarted","Data":"be0ab7193e3849ea73efa667a0f842c4fa59d0c234014604b78305263723106b"} Jun 10 15:02:01.315455 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.315436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vrg5n" event={"ID":"7cac5aad-c80a-4d2e-b4aa-e881b8e5a380","Type":"ContainerStarted","Data":"9ec114d9299ebee4a5b4f27b8e815422c2b6a76a5e2f7d9d5c94b256065a1321"} Jun 10 15:02:01.332969 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.332932 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-243.ec2.internal" podStartSLOduration=21.332918618 podStartE2EDuration="21.332918618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:01:43.281997091 +0000 UTC m=+4.499763695" watchObservedRunningTime="2026-06-10 15:02:01.332918618 +0000 UTC m=+22.550685216" Jun 10 15:02:01.333433 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.333407 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-whp5p" podStartSLOduration=3.399809329 podStartE2EDuration="22.333400267s" totalImagesPullingTime="18.933590938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:01.333189606 +0000 UTC m=+22.550956207" watchObservedRunningTime="2026-06-10 15:02:01.333400267 +0000 UTC m=+22.551166868" Jun 10 15:02:01.355466 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.355371 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l8n28" podStartSLOduration=11.830137768 podStartE2EDuration="22.355358093s" totalImagesPullingTime="10.525220325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:01.355072393 +0000 UTC m=+22.572838994" watchObservedRunningTime="2026-06-10 15:02:01.355358093 +0000 UTC m=+22.573124695" Jun 10 15:02:01.416409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.416369 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jwf6d" podStartSLOduration=3.56384139 podStartE2EDuration="22.416355674s" totalImagesPullingTime="18.852514284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:01.399248335 +0000 UTC m=+22.617014936" watchObservedRunningTime="2026-06-10 15:02:01.416355674 +0000 UTC m=+22.634122315" Jun 10 15:02:01.416504 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.416486 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vrg5n" podStartSLOduration=3.563527797 podStartE2EDuration="22.416483198s" totalImagesPullingTime="18.852955401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:01.416304704 +0000 UTC m=+22.634071306" watchObservedRunningTime="2026-06-10 15:02:01.416483198 +0000 UTC m=+22.634249817" Jun 10 15:02:01.436126 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:01.436087 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k74jx" podStartSLOduration=3.585890353 podStartE2EDuration="22.436072428s" totalImagesPullingTime="18.850182075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:01.435700146 +0000 UTC m=+22.653466747" watchObservedRunningTime="2026-06-10 15:02:01.436072428 +0000 UTC m=+22.653839030" Jun 10 15:02:02.217990 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.217962 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:02.218193 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:02.218078 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:02.316926 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.316887 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:02:02.317575 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.317543 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:02:02.320395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.320370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhdjk" event={"ID":"4a6fbe2a-8e3a-4e3c-8ce3-2e912674bac7","Type":"ContainerStarted","Data":"ca02ebbb3c138fe470129ec692642badafbb395d69ed33dcb25f9ca96fcd52e9"} Jun 10 15:02:02.326152 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.325198 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"1bc94ca5fc54745eeeeb955798b795db6dc4a039ce4dc0ccee687090efced7a9"} Jun 10 15:02:02.326152 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.325269 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"32abac4c45b562cfe7a04a5fde46fd38c6a60f046995b47765feea869321b39a"} Jun 10 15:02:02.326152 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.326111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:02:02.326713 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.326696 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l8n28" Jun 10 15:02:02.378909 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.378876 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 15:02:02.379544 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:02.379503 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhdjk" podStartSLOduration=4.535284773 podStartE2EDuration="23.379487943s" totalImagesPullingTime="18.84420317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:02.379378457 +0000 UTC m=+23.597145060" watchObservedRunningTime="2026-06-10 15:02:02.379487943 +0000 UTC m=+23.597254544" Jun 10 15:02:03.217765 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.217736 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:03.218036 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:03.217860 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:03.218036 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.217929 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:03.218161 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:03.218055 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:03.219827 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.219754 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T15:02:02.378901707Z","UUID":"ce878f02-46d5-4e5f-a2ca-baa5d4095b4c","Handler":null,"Name":"","Endpoint":""} Jun 10 15:02:03.221461 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.221443 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 15:02:03.221597 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.221481 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 15:02:03.329196 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:03.329147 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" event={"ID":"7c00685c-08a3-429f-8db7-818dd3041b38","Type":"ContainerStarted","Data":"7a992a2646cb7add78aea93c5f406b99c9e1a39c4dad4b8942158f2ae398f9ac"} Jun 10 15:02:04.218003 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:04.217968 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:04.218191 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:04.218090 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:04.335207 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:04.335164 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" event={"ID":"7c00685c-08a3-429f-8db7-818dd3041b38","Type":"ContainerStarted","Data":"fd6e88eaa32515dbdca0cf938cd6557e2ef2fa77955ca9fe7032afe58b760b52"} Jun 10 15:02:04.339901 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:04.339869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"bd33ca65592a227fe668836af8c6ee24f247728dd7d7cdd9158048bbbb844b1b"} Jun 10 15:02:04.355881 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:04.355831 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc6df" podStartSLOduration=4.298861352 podStartE2EDuration="25.355815154s" totalImagesPullingTime="21.056953802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:04.355452984 +0000 UTC m=+25.573219600" watchObservedRunningTime="2026-06-10 15:02:04.355815154 +0000 UTC m=+25.573581766" Jun 10 15:02:05.217726 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:05.217512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:05.217906 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:05.217512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:05.217906 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:05.217839 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:05.218014 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:05.217957 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:06.218276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.218245 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:06.218973 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:06.218343 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:06.345937 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.345900 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="a41ec195d0c9bb77bfcbe043e8dbdb683c34b35289000e36cd08c60fae04623b" exitCode=0 Jun 10 15:02:06.346125 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.345984 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"a41ec195d0c9bb77bfcbe043e8dbdb683c34b35289000e36cd08c60fae04623b"} Jun 10 15:02:06.349766 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.349743 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" event={"ID":"0d3f62e6-b211-4021-a728-2d052202951e","Type":"ContainerStarted","Data":"9285b0503d52e542b0accd261929a3dbf6982f7ee029f9fb3cf2d2ea7c2904d1"} Jun 10 15:02:06.349988 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.349971 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:06.350059 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.350032 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:06.350177 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.350069 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:06.366134 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.365976 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:06.366235 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.366228 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:06.402666 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:06.402624 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" podStartSLOduration=8.539134883 podStartE2EDuration="27.40260912s" totalImagesPullingTime="18.863474237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:06.402188025 +0000 UTC m=+27.619954627" watchObservedRunningTime="2026-06-10 15:02:06.40260912 +0000 UTC m=+27.620375721" Jun 10 15:02:07.221269 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.221239 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:07.221653 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:07.221336 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:07.221653 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.221388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:07.221653 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:07.221477 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:07.713809 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.713775 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlkxx"] Jun 10 15:02:07.714029 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.713900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:07.714029 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:07.714008 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:07.714437 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.714412 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnt86"] Jun 10 15:02:07.714536 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.714492 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:07.714591 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:07.714574 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:07.716056 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.716033 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkzl6"] Jun 10 15:02:07.716158 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:07.716124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:07.716244 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:07.716227 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:08.356758 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:08.356726 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="a1f67d12dd13993e20776624a3f8e353ef4f4111a2ab1a9adb3af1b42c278daa" exitCode=0 Jun 10 15:02:08.357252 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:08.356810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"a1f67d12dd13993e20776624a3f8e353ef4f4111a2ab1a9adb3af1b42c278daa"} Jun 10 15:02:09.218299 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:09.218269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:09.218468 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:09.218363 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:09.218468 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:09.218386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:09.218468 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:09.218443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:09.218625 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:09.218520 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:09.218625 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:09.218598 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:10.365308 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:10.365048 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="e73d414722e3ab09afbd8ba27ae52bea87ccd333c705d80edda32a46c6ff83f7" exitCode=0 Jun 10 15:02:10.367699 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:10.366669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"e73d414722e3ab09afbd8ba27ae52bea87ccd333c705d80edda32a46c6ff83f7"} Jun 10 15:02:11.221123 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:11.221087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:11.221290 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:11.221222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:11.221290 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:11.221224 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:11.221290 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:11.221248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:11.221426 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:11.221368 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:11.221535 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:11.221433 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:12.909910 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:12.909878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:12.910378 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:12.909958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:12.910378 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:12.910055 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:02:12.910378 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:12.910133 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:02:44.910112347 +0000 UTC m=+66.127878943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 15:02:12.910378 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:12.910064 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 15:02:12.910378 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:12.910180 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret podName:3f5dc4e4-4cc7-465f-9ab4-204d385f6865 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:44.910169694 +0000 UTC m=+66.127936280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret") pod "global-pull-secret-syncer-zlkxx" (UID: "3f5dc4e4-4cc7-465f-9ab4-204d385f6865") : object "kube-system"/"original-pull-secret" not registered Jun 10 15:02:13.010703 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.010674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:13.010880 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.010865 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 15:02:13.010929 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.010892 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 15:02:13.010929 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.010905 2573 projected.go:196] Error preparing data for projected volume kube-api-access-q4rtx for pod openshift-network-diagnostics/network-check-target-bnt86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:02:13.011033 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.010966 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx podName:361aed07-d620-4569-bace-3c6eba12cb99 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:45.010947082 +0000 UTC m=+66.228713667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q4rtx" (UniqueName: "kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx") pod "network-check-target-bnt86" (UID: "361aed07-d620-4569-bace-3c6eba12cb99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 15:02:13.220970 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.220896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:13.220970 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.220920 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:13.220970 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.220925 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:13.221219 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.221025 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlkxx" podUID="3f5dc4e4-4cc7-465f-9ab4-204d385f6865" Jun 10 15:02:13.221219 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.221149 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnt86" podUID="361aed07-d620-4569-bace-3c6eba12cb99" Jun 10 15:02:13.221314 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.221249 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:02:13.608113 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.608082 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-243.ec2.internal" event="NodeReady" Jun 10 15:02:13.608287 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.608225 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 15:02:13.673253 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.673219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7x775"] Jun 10 15:02:13.676777 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.676121 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.677543 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.677524 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ffk9m"] Jun 10 15:02:13.678545 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.678524 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 15:02:13.678684 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.678656 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-982f9\"" Jun 10 15:02:13.678968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.678952 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 15:02:13.679523 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.679502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.697370 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.697291 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 15:02:13.697481 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.697372 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 15:02:13.697481 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.697430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 15:02:13.697953 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.697931 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lvtpz\"" Jun 10 15:02:13.711958 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.711938 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7x775"] Jun 10 15:02:13.734109 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.734087 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ffk9m"] Jun 10 15:02:13.818692 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818656 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmhq\" (UniqueName: \"kubernetes.io/projected/cd3d4fe4-985c-4f33-89c4-3da4995912f9-kube-api-access-bdmhq\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.818877 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818747 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.818877 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-cert\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.818877 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818857 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4fe4-985c-4f33-89c4-3da4995912f9-config-volume\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.819030 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818880 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3d4fe4-985c-4f33-89c4-3da4995912f9-tmp-dir\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.819030 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.818905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7hp\" (UniqueName: \"kubernetes.io/projected/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-kube-api-access-hk7hp\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.919982 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.919898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4fe4-985c-4f33-89c4-3da4995912f9-config-volume\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.919982 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.919942 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3d4fe4-985c-4f33-89c4-3da4995912f9-tmp-dir\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.919982 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.919966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7hp\" (UniqueName: \"kubernetes.io/projected/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-kube-api-access-hk7hp\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.919996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmhq\" (UniqueName: \"kubernetes.io/projected/cd3d4fe4-985c-4f33-89c4-3da4995912f9-kube-api-access-bdmhq\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.920039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.920058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-cert\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.920174 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:13.920247 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:14.420227512 +0000 UTC m=+35.637994108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.920334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3d4fe4-985c-4f33-89c4-3da4995912f9-tmp-dir\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.920673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.920611 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3d4fe4-985c-4f33-89c4-3da4995912f9-config-volume\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.924678 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.924656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-cert\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.931925 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.931901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmhq\" (UniqueName: \"kubernetes.io/projected/cd3d4fe4-985c-4f33-89c4-3da4995912f9-kube-api-access-bdmhq\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:13.932459 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.932440 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7hp\" (UniqueName: \"kubernetes.io/projected/75aa764b-d74e-4bcf-af6f-4ba0cb19246b-kube-api-access-hk7hp\") pod \"ingress-canary-ffk9m\" (UID: \"75aa764b-d74e-4bcf-af6f-4ba0cb19246b\") " pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:13.995949 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:13.995920 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ffk9m" Jun 10 15:02:14.382385 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:14.382190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ffk9m"] Jun 10 15:02:14.385633 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:02:14.385611 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75aa764b_d74e_4bcf_af6f_4ba0cb19246b.slice/crio-64c048bcb32829356019dded47aaf5e8a96496d60137f62310376c561b5ffad1 WatchSource:0}: Error finding container 64c048bcb32829356019dded47aaf5e8a96496d60137f62310376c561b5ffad1: Status 404 returned error can't find the container with id 64c048bcb32829356019dded47aaf5e8a96496d60137f62310376c561b5ffad1 Jun 10 15:02:14.423348 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:14.423312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:14.423479 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:14.423465 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:14.423545 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:14.423532 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:15.423517113 +0000 UTC m=+36.641283694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:15.220961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.220931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:15.221735 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.220970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:15.221735 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.220970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:15.223662 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.223620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 15:02:15.223780 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.223667 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 15:02:15.223780 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.223688 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 15:02:15.224506 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.224434 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz4k2\"" Jun 10 15:02:15.224506 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.224472 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 15:02:15.224506 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.224497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8lwdb\"" Jun 10 15:02:15.382997 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.382959 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="cbb9d33bdef59fde91e88306388d9735c48dd2ef66b39c339e441997c086eae0" exitCode=0 Jun 10 15:02:15.383165 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.383043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"cbb9d33bdef59fde91e88306388d9735c48dd2ef66b39c339e441997c086eae0"} Jun 10 15:02:15.384269 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.384250 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ffk9m" event={"ID":"75aa764b-d74e-4bcf-af6f-4ba0cb19246b","Type":"ContainerStarted","Data":"64c048bcb32829356019dded47aaf5e8a96496d60137f62310376c561b5ffad1"} Jun 10 15:02:15.430257 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:15.430225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:15.430418 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:15.430382 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:15.430479 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:15.430458 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:17.430440748 +0000 UTC m=+38.648207328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:16.389947 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:16.389914 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8" containerID="19485437e92356aaea53db70149842a3ceba5813ec4862e14d99f18cf7b407d0" exitCode=0 Jun 10 15:02:16.390462 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:16.389994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerDied","Data":"19485437e92356aaea53db70149842a3ceba5813ec4862e14d99f18cf7b407d0"} Jun 10 15:02:16.391608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:16.391581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ffk9m" event={"ID":"75aa764b-d74e-4bcf-af6f-4ba0cb19246b","Type":"ContainerStarted","Data":"314066c26ebfee34ee6de1ecebd126795f8ea309af4788e0891227d27bca4e04"} Jun 10 15:02:17.397062 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:17.396888 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" event={"ID":"3e514aed-ba6b-4972-b7ea-0e0e2fbf32a8","Type":"ContainerStarted","Data":"57af70aa0ca665f011a364135e70ec2d14990518d6ce298c4fbf58d1b577795c"} Jun 10 15:02:17.421490 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:17.421450 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mp8pr" podStartSLOduration=9.291170783 podStartE2EDuration="38.421434275s" totalImagesPullingTime="29.130263492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:17.420513945 +0000 UTC m=+38.638280547" watchObservedRunningTime="2026-06-10 15:02:17.421434275 +0000 UTC m=+38.639200876" Jun 10 15:02:17.422072 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:17.422035 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ffk9m" podStartSLOduration=2.823257482 podStartE2EDuration="4.422024629s" totalImagesPullingTime="1.598767147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:16.434427187 +0000 UTC m=+37.652193790" watchObservedRunningTime="2026-06-10 15:02:17.422024629 +0000 UTC m=+38.639791233" Jun 10 15:02:17.447293 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:17.447268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:17.447424 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:17.447392 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:17.447459 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:17.447440 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:21.447428448 +0000 UTC m=+42.665195028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:21.473250 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:21.473211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:21.473657 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:21.473359 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:21.473657 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:21.473421 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:29.473406372 +0000 UTC m=+50.691172952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:26.151764 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.151724 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj"] Jun 10 15:02:26.165308 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.165281 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.167884 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.167858 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 15:02:26.167884 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.167871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 15:02:26.168063 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.167876 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 15:02:26.168063 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.167926 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 15:02:26.168063 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.167867 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 15:02:26.168586 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.168571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 15:02:26.168676 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.168660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 15:02:26.169822 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.169800 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj"] Jun 10 15:02:26.206091 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c9a827-c508-4970-b90f-f45306509df2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.206208 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.206208 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.206208 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206172 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vcx\" (UniqueName: \"kubernetes.io/projected/68c9a827-c508-4970-b90f-f45306509df2-kube-api-access-54vcx\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.206208 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.206365 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.206245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307251 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307251 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307449 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vcx\" (UniqueName: \"kubernetes.io/projected/68c9a827-c508-4970-b90f-f45306509df2-kube-api-access-54vcx\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307449 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307449 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.307635 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.307612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c9a827-c508-4970-b90f-f45306509df2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.317545 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.317501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68c9a827-c508-4970-b90f-f45306509df2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.317711 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.317586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.317711 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.317596 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.317711 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.317591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-hub\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.317931 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.317903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68c9a827-c508-4970-b90f-f45306509df2-ca\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.319114 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.319096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vcx\" (UniqueName: \"kubernetes.io/projected/68c9a827-c508-4970-b90f-f45306509df2-kube-api-access-54vcx\") pod \"cluster-proxy-proxy-agent-5557b77fd7-tbzrj\" (UID: \"68c9a827-c508-4970-b90f-f45306509df2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.485618 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.485590 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:02:26.628913 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:26.628880 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj"] Jun 10 15:02:26.632703 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:02:26.632678 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68c9a827_c508_4970_b90f_f45306509df2.slice/crio-c8c7193a268bd7f8ffc98af426a54fbd586ee928512ea5f40ec81df83688f2c8 WatchSource:0}: Error finding container c8c7193a268bd7f8ffc98af426a54fbd586ee928512ea5f40ec81df83688f2c8: Status 404 returned error can't find the container with id c8c7193a268bd7f8ffc98af426a54fbd586ee928512ea5f40ec81df83688f2c8 Jun 10 15:02:27.421926 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:27.421891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerStarted","Data":"c8c7193a268bd7f8ffc98af426a54fbd586ee928512ea5f40ec81df83688f2c8"} Jun 10 15:02:29.531924 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:29.531885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:29.532348 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:29.532054 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:29.532348 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:29.532149 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:02:45.532126637 +0000 UTC m=+66.749893220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:31.433307 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:31.433280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerStarted","Data":"ab27b336184c1b7336395657ee552791742cf55720395081a387045d1bbdb7ed"} Jun 10 15:02:31.433601 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:31.433324 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerStarted","Data":"b8b0f9cd9b8ae6b0dd9db76abb39619fba33b65562dc10e1009d8f935fef8190"} Jun 10 15:02:32.437121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:32.437088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerStarted","Data":"c06647ef90387e1cce19c2e3870d9d3ed03afe4539c2f6a0a470e8a09aea685c"} Jun 10 15:02:32.464985 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:32.464940 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" podStartSLOduration=1.893056 podStartE2EDuration="6.464925272s" totalImagesPullingTime="4.571869272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:32.464463565 +0000 UTC m=+53.682230170" watchObservedRunningTime="2026-06-10 15:02:32.464925272 +0000 UTC m=+53.682691906" Jun 10 15:02:38.373303 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:38.373264 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vw9bd" Jun 10 15:02:44.943433 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:44.943388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:44.943938 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:44.943452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:02:44.946274 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:44.946253 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 15:02:44.946274 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:44.946262 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 15:02:44.954275 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:44.954255 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 15:02:44.954360 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:44.954320 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:03:48.954304609 +0000 UTC m=+130.172071189 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : secret "metrics-daemon-secret" not found Jun 10 15:02:44.956334 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:44.956317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f5dc4e4-4cc7-465f-9ab4-204d385f6865-original-pull-secret\") pod \"global-pull-secret-syncer-zlkxx\" (UID: \"3f5dc4e4-4cc7-465f-9ab4-204d385f6865\") " pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:45.044788 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.044751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:45.047687 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.047664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 15:02:45.058209 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.058187 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 15:02:45.069031 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.069002 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rtx\" (UniqueName: \"kubernetes.io/projected/361aed07-d620-4569-bace-3c6eba12cb99-kube-api-access-q4rtx\") pod \"network-check-target-bnt86\" (UID: \"361aed07-d620-4569-bace-3c6eba12cb99\") " pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:45.232196 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.232172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlkxx" Jun 10 15:02:45.241835 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.241807 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8lwdb\"" Jun 10 15:02:45.250195 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.250171 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:45.391927 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.391897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlkxx"] Jun 10 15:02:45.395398 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:02:45.395372 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5dc4e4_4cc7_465f_9ab4_204d385f6865.slice/crio-8be182336387e65de779df92f89ff86b547dcdd89f3d2a4ba68d3d2c522c8c9c WatchSource:0}: Error finding container 8be182336387e65de779df92f89ff86b547dcdd89f3d2a4ba68d3d2c522c8c9c: Status 404 returned error can't find the container with id 8be182336387e65de779df92f89ff86b547dcdd89f3d2a4ba68d3d2c522c8c9c Jun 10 15:02:45.418744 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.418717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnt86"] Jun 10 15:02:45.421742 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:02:45.421708 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361aed07_d620_4569_bace_3c6eba12cb99.slice/crio-a18e73e9cca40a2b471867c5116351f3e86677bbdd42a3f276ebfa1d60a579ee WatchSource:0}: Error finding container a18e73e9cca40a2b471867c5116351f3e86677bbdd42a3f276ebfa1d60a579ee: Status 404 returned error can't find the container with id a18e73e9cca40a2b471867c5116351f3e86677bbdd42a3f276ebfa1d60a579ee Jun 10 15:02:45.465781 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.465745 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnt86" event={"ID":"361aed07-d620-4569-bace-3c6eba12cb99","Type":"ContainerStarted","Data":"a18e73e9cca40a2b471867c5116351f3e86677bbdd42a3f276ebfa1d60a579ee"} Jun 10 15:02:45.466794 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.466774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlkxx" event={"ID":"3f5dc4e4-4cc7-465f-9ab4-204d385f6865","Type":"ContainerStarted","Data":"8be182336387e65de779df92f89ff86b547dcdd89f3d2a4ba68d3d2c522c8c9c"} Jun 10 15:02:45.549213 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:45.549135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:02:45.549342 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:45.549286 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:02:45.549386 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:02:45.549375 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:03:17.549360944 +0000 UTC m=+98.767127523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:02:50.482576 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:50.482531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlkxx" event={"ID":"3f5dc4e4-4cc7-465f-9ab4-204d385f6865","Type":"ContainerStarted","Data":"6ee61d68b5663a46a9ac492c1230ffe3c79ab4538e9a4526cfc6d2f1e7181d6c"} Jun 10 15:02:50.483944 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:50.483917 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnt86" event={"ID":"361aed07-d620-4569-bace-3c6eba12cb99","Type":"ContainerStarted","Data":"49533aea5f2e31b454bf0875cd6d24d79d0f0d20e9cc471ba863730b856b6ca0"} Jun 10 15:02:50.484079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:50.484045 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:02:50.503081 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:50.503042 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zlkxx" podStartSLOduration=66.757021321 podStartE2EDuration="1m11.503028557s" totalImagesPullingTime="4.746007236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:50.501714291 +0000 UTC m=+71.719480892" watchObservedRunningTime="2026-06-10 15:02:50.503028557 +0000 UTC m=+71.720795159" Jun 10 15:02:50.519675 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:02:50.519637 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bnt86" podStartSLOduration=66.800044649 podStartE2EDuration="1m11.519623799s" totalImagesPullingTime="4.71957915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:02:50.518840109 +0000 UTC m=+71.736606711" watchObservedRunningTime="2026-06-10 15:02:50.519623799 +0000 UTC m=+71.737390400" Jun 10 15:03:17.563968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:03:17.563881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:03:17.564472 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:03:17.564038 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:03:17.564472 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:03:17.564116 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:04:21.564092805 +0000 UTC m=+162.781859391 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:03:21.489056 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:03:21.489025 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bnt86" Jun 10 15:03:48.980930 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:03:48.980882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:03:48.981413 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:03:48.980997 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 15:03:48.981413 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:03:48.981093 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:05:50.981077816 +0000 UTC m=+252.198844396 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : secret "metrics-daemon-secret" not found Jun 10 15:04:16.691483 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:04:16.691439 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7x775" podUID="cd3d4fe4-985c-4f33-89c4-3da4995912f9" Jun 10 15:04:16.724537 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:04:16.724515 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7x775" Jun 10 15:04:18.245548 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:04:18.245499 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:04:21.599734 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:04:21.599694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:04:21.600131 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:04:21.599822 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 15:04:21.600131 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:04:21.599872 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls podName:cd3d4fe4-985c-4f33-89c4-3da4995912f9 nodeName:}" failed. No retries permitted until 2026-06-10 15:06:23.599859979 +0000 UTC m=+284.817626559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls") pod "dns-default-7x775" (UID: "cd3d4fe4-985c-4f33-89c4-3da4995912f9") : secret "dns-default-metrics-tls" not found Jun 10 15:04:29.219320 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:04:29.219237 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:05:37.706180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.706146 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-krnfh"] Jun 10 15:05:37.707867 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.707850 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.713179 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.713154 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 15:05:37.713498 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.713481 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 15:05:37.714287 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.714270 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 15:05:37.714523 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.714505 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bm7r8\"" Jun 10 15:05:37.714740 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.714724 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 15:05:37.726855 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.726833 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 15:05:37.728936 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.728919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7w4z\" (UniqueName: \"kubernetes.io/projected/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-kube-api-access-b7w4z\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.729001 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.728949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-trusted-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.729001 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.728971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-serving-cert\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.729082 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.728998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-service-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.729126 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.729088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-tmp\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.729126 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.729112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-snapshots\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.737319 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.737296 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-krnfh"] Jun 10 15:05:37.830095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-tmp\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-snapshots\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830285 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7w4z\" (UniqueName: \"kubernetes.io/projected/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-kube-api-access-b7w4z\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830285 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-trusted-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830711 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-serving-cert\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830802 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-service-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.830911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.830888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-tmp\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.831247 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.831223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-snapshots\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.831571 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.831542 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-service-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.835183 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.835161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-trusted-ca-bundle\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.836168 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.836153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-serving-cert\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:37.850060 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:37.850037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7w4z\" (UniqueName: \"kubernetes.io/projected/0ac2b1de-45f2-44eb-b221-1b3c660cd3fb-kube-api-access-b7w4z\") pod \"insights-operator-896549976-krnfh\" (UID: \"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb\") " pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:38.016367 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:38.016341 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-krnfh" Jun 10 15:05:38.164117 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:38.164031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-krnfh"] Jun 10 15:05:38.166114 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:05:38.166093 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac2b1de_45f2_44eb_b221_1b3c660cd3fb.slice/crio-eb2e8e818cbb537825702da3397f76d1f781d287ec846fbf371a2622499297a2 WatchSource:0}: Error finding container eb2e8e818cbb537825702da3397f76d1f781d287ec846fbf371a2622499297a2: Status 404 returned error can't find the container with id eb2e8e818cbb537825702da3397f76d1f781d287ec846fbf371a2622499297a2 Jun 10 15:05:38.950773 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:38.950730 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-krnfh" event={"ID":"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb","Type":"ContainerStarted","Data":"eb2e8e818cbb537825702da3397f76d1f781d287ec846fbf371a2622499297a2"} Jun 10 15:05:40.959198 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:40.959124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-krnfh" event={"ID":"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb","Type":"ContainerStarted","Data":"88652aaad05642de255b0cf5011c5a07bb4c2c6c63611010f24cfd5b075459c8"} Jun 10 15:05:41.007414 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:41.007368 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-krnfh" podStartSLOduration=1.8818406730000001 podStartE2EDuration="4.007350624s" totalImagesPullingTime="2.125509951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:05:41.007308158 +0000 UTC m=+242.225074796" watchObservedRunningTime="2026-06-10 15:05:41.007350624 +0000 UTC m=+242.225117226" Jun 10 15:05:43.212285 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:43.212255 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k74jx_5d25317a-5b82-40ba-883c-6e9f08e46323/dns-node-resolver/0.log" Jun 10 15:05:44.171513 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:44.171485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrg5n_7cac5aad-c80a-4d2e-b4aa-e881b8e5a380/node-ca/0.log" Jun 10 15:05:44.825141 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:44.825109 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ffk9m_75aa764b-d74e-4bcf-af6f-4ba0cb19246b/serve-healthcheck-canary/0.log" Jun 10 15:05:51.025430 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:05:51.025390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:05:51.025842 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:05:51.025534 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 15:05:51.025842 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:05:51.025624 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs podName:52f5b41b-9ddb-4545-b0ae-af9db2b36edb nodeName:}" failed. No retries permitted until 2026-06-10 15:07:53.02560638 +0000 UTC m=+374.243372964 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs") pod "network-metrics-daemon-nkzl6" (UID: "52f5b41b-9ddb-4545-b0ae-af9db2b36edb") : secret "metrics-daemon-secret" not found Jun 10 15:06:09.814741 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.814657 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fp6jt"] Jun 10 15:06:09.816608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.816591 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84f7f9bd99-ckftc"] Jun 10 15:06:09.816710 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.816691 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.818475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.818455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.819489 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.819451 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zpmwr\"" Jun 10 15:06:09.819489 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.819483 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 15:06:09.820306 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.820291 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 15:06:09.822758 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.822737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 15:06:09.822853 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.822778 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 15:06:09.822853 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.822778 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nnbbk\"" Jun 10 15:06:09.824889 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.824874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 15:06:09.830035 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.830018 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 15:06:09.836108 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.836089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fp6jt"] Jun 10 15:06:09.836936 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.836915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f7f9bd99-ckftc"] Jun 10 15:06:09.859989 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.859966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-crio-socket\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.860121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-installation-pull-secrets\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.860121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de9caf53-46d4-4878-96fe-ac8a762141b1-ca-trust-extracted\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-bound-sa-token\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-tls\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-certificates\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xhc\" (UniqueName: \"kubernetes.io/projected/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-api-access-j6xhc\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-data-volume\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n74zk\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-kube-api-access-n74zk\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-trusted-ca\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.860277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.860266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-image-registry-private-configuration\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.960660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.960660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-trusted-ca\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.960882 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-image-registry-private-configuration\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.960882 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-crio-socket\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.960882 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-installation-pull-secrets\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de9caf53-46d4-4878-96fe-ac8a762141b1-ca-trust-extracted\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-crio-socket\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-bound-sa-token\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.960991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-tls\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-certificates\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961079 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xhc\" (UniqueName: \"kubernetes.io/projected/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-api-access-j6xhc\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.961423 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-data-volume\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.961423 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n74zk\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-kube-api-access-n74zk\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961423 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961291 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de9caf53-46d4-4878-96fe-ac8a762141b1-ca-trust-extracted\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961423 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961309 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.961764 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-trusted-ca\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.961764 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.961754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-data-volume\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.962103 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.962084 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-certificates\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.963487 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.963471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.963625 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.963606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-installation-pull-secrets\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.963780 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.963762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-registry-tls\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.963821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.963757 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de9caf53-46d4-4878-96fe-ac8a762141b1-image-registry-private-configuration\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.978431 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.978400 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xhc\" (UniqueName: \"kubernetes.io/projected/8e8ebccb-a946-45a0-a460-d3cc0f434ed9-kube-api-access-j6xhc\") pod \"insights-runtime-extractor-fp6jt\" (UID: \"8e8ebccb-a946-45a0-a460-d3cc0f434ed9\") " pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:09.978748 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.978726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n74zk\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-kube-api-access-n74zk\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:09.979837 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:09.979820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de9caf53-46d4-4878-96fe-ac8a762141b1-bound-sa-token\") pod \"image-registry-84f7f9bd99-ckftc\" (UID: \"de9caf53-46d4-4878-96fe-ac8a762141b1\") " pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:10.126978 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:10.126884 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fp6jt" Jun 10 15:06:10.131383 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:10.131354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:10.276883 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:10.276853 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f7f9bd99-ckftc"] Jun 10 15:06:10.279738 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:10.279706 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9caf53_46d4_4878_96fe_ac8a762141b1.slice/crio-0eeb29977da09f755b82e863d94976e2cca0b284dc62ad5d9d7704a8364015f8 WatchSource:0}: Error finding container 0eeb29977da09f755b82e863d94976e2cca0b284dc62ad5d9d7704a8364015f8: Status 404 returned error can't find the container with id 0eeb29977da09f755b82e863d94976e2cca0b284dc62ad5d9d7704a8364015f8 Jun 10 15:06:10.297501 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:10.297478 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fp6jt"] Jun 10 15:06:10.310512 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:10.310490 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8ebccb_a946_45a0_a460_d3cc0f434ed9.slice/crio-ace6d4d452f98945d7a48f7880b31ab24ebf4050b598e26a3048c9f79e24ee0a WatchSource:0}: Error finding container ace6d4d452f98945d7a48f7880b31ab24ebf4050b598e26a3048c9f79e24ee0a: Status 404 returned error can't find the container with id ace6d4d452f98945d7a48f7880b31ab24ebf4050b598e26a3048c9f79e24ee0a Jun 10 15:06:11.042158 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.042117 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fp6jt" event={"ID":"8e8ebccb-a946-45a0-a460-d3cc0f434ed9","Type":"ContainerStarted","Data":"e74aa80e5a0ee60cc7941256789251a7efd02266ebada6ee991fb2c716e158ce"} Jun 10 15:06:11.042554 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.042227 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fp6jt" event={"ID":"8e8ebccb-a946-45a0-a460-d3cc0f434ed9","Type":"ContainerStarted","Data":"6a8905bce6b77c5c3c008c696e0813981b1e34fc52453fa501b0fe119f9c29c8"} Jun 10 15:06:11.042554 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.042262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fp6jt" event={"ID":"8e8ebccb-a946-45a0-a460-d3cc0f434ed9","Type":"ContainerStarted","Data":"ace6d4d452f98945d7a48f7880b31ab24ebf4050b598e26a3048c9f79e24ee0a"} Jun 10 15:06:11.043501 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.043478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" event={"ID":"de9caf53-46d4-4878-96fe-ac8a762141b1","Type":"ContainerStarted","Data":"01abfcd12ce413257b3da8951113a8cf9300a25a53a2c3e480011bb8c34b8a9b"} Jun 10 15:06:11.043592 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.043519 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" event={"ID":"de9caf53-46d4-4878-96fe-ac8a762141b1","Type":"ContainerStarted","Data":"0eeb29977da09f755b82e863d94976e2cca0b284dc62ad5d9d7704a8364015f8"} Jun 10 15:06:11.043645 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.043605 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:11.077179 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:11.077134 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" podStartSLOduration=2.077121607 podStartE2EDuration="2.077121607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:11.076100211 +0000 UTC m=+272.293866823" watchObservedRunningTime="2026-06-10 15:06:11.077121607 +0000 UTC m=+272.294888209" Jun 10 15:06:13.051692 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:13.051654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fp6jt" event={"ID":"8e8ebccb-a946-45a0-a460-d3cc0f434ed9","Type":"ContainerStarted","Data":"b9b1b1f0182fa09dc914f751c8b339a1341708e19ad6233fe6537a3b24980578"} Jun 10 15:06:13.095153 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:13.095100 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fp6jt" podStartSLOduration=1.8217625819999999 podStartE2EDuration="4.095082982s" totalImagesPullingTime="2.2733204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:06:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:13.095045581 +0000 UTC m=+274.312812184" watchObservedRunningTime="2026-06-10 15:06:13.095082982 +0000 UTC m=+274.312849574" Jun 10 15:06:19.725756 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:19.725706 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7x775" podUID="cd3d4fe4-985c-4f33-89c4-3da4995912f9" Jun 10 15:06:20.070954 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:20.070876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7x775" Jun 10 15:06:21.022440 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.022408 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c7lkx"] Jun 10 15:06:21.025210 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.025194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.027789 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.027766 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 15:06:21.027916 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.027841 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 15:06:21.027916 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.027858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 15:06:21.028625 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.028607 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 15:06:21.028625 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.028624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 15:06:21.028829 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.028611 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 15:06:21.028829 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.028614 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x5prf\"" Jun 10 15:06:21.147031 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.146998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-wtmp\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147031 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkklm\" (UniqueName: \"kubernetes.io/projected/7d18aec2-9264-469a-a09f-7fa2c2c5144c-kube-api-access-bkklm\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-root\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-textfile\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147266 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-sys\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147445 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-metrics-client-ca\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.147445 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.147285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.151398 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.151376 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf"] Jun 10 15:06:21.153406 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.153389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.155763 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.155745 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 15:06:21.155897 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.155879 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 15:06:21.156083 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.156071 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 15:06:21.156329 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.156317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gg2j2\"" Jun 10 15:06:21.171107 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.171081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf"] Jun 10 15:06:21.248107 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-wtmp\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248107 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkklm\" (UniqueName: \"kubernetes.io/projected/7d18aec2-9264-469a-a09f-7fa2c2c5144c-kube-api-access-bkklm\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-root\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-textfile\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-wtmp\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-root\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgd5m\" (UniqueName: \"kubernetes.io/projected/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-api-access-fgd5m\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.248352 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.248334 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.248398 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls podName:7d18aec2-9264-469a-a09f-7fa2c2c5144c nodeName:}" failed. No retries permitted until 2026-06-10 15:06:21.748378961 +0000 UTC m=+282.966145546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls") pod "node-exporter-c7lkx" (UID: "7d18aec2-9264-469a-a09f-7fa2c2c5144c") : secret "node-exporter-tls" not found Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-sys\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-metrics-client-ca\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d18aec2-9264-469a-a09f-7fa2c2c5144c-sys\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248604 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-textfile\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.248826 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.249264 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.248989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.249264 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.249123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d18aec2-9264-469a-a09f-7fa2c2c5144c-metrics-client-ca\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.250421 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.250402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.258053 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.258025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkklm\" (UniqueName: \"kubernetes.io/projected/7d18aec2-9264-469a-a09f-7fa2c2c5144c-kube-api-access-bkklm\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.349960 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.349862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.349960 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.349933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgd5m\" (UniqueName: \"kubernetes.io/projected/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-api-access-fgd5m\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.349960 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.349961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350230 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.349996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350230 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.350138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350230 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.350217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350380 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.350348 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 15:06:21.350428 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.350413 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls podName:d06dd82e-5cf3-4c41-831f-4cd0d0977a82 nodeName:}" failed. No retries permitted until 2026-06-10 15:06:21.850395993 +0000 UTC m=+283.068162592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-gzjxf" (UID: "d06dd82e-5cf3-4c41-831f-4cd0d0977a82") : secret "kube-state-metrics-tls" not found Jun 10 15:06:21.350511 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.350489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350612 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.350590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.350678 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.350636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.352378 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.352344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.364016 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.363996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgd5m\" (UniqueName: \"kubernetes.io/projected/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-api-access-fgd5m\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.753457 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.753421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:21.753665 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.753643 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 15:06:21.753745 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:21.753729 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls podName:7d18aec2-9264-469a-a09f-7fa2c2c5144c nodeName:}" failed. No retries permitted until 2026-06-10 15:06:22.753706405 +0000 UTC m=+283.971473005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls") pod "node-exporter-c7lkx" (UID: "7d18aec2-9264-469a-a09f-7fa2c2c5144c") : secret "node-exporter-tls" not found Jun 10 15:06:21.854877 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.854835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:21.857243 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:21.857212 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d06dd82e-5cf3-4c41-831f-4cd0d0977a82-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-gzjxf\" (UID: \"d06dd82e-5cf3-4c41-831f-4cd0d0977a82\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:22.061760 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.061671 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" Jun 10 15:06:22.203435 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.203403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf"] Jun 10 15:06:22.206335 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:22.206309 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06dd82e_5cf3_4c41_831f_4cd0d0977a82.slice/crio-0f2f6b576cfc4ea9fe84807e6c41ed646f44e29ce0e9368c335205eea01dbe2d WatchSource:0}: Error finding container 0f2f6b576cfc4ea9fe84807e6c41ed646f44e29ce0e9368c335205eea01dbe2d: Status 404 returned error can't find the container with id 0f2f6b576cfc4ea9fe84807e6c41ed646f44e29ce0e9368c335205eea01dbe2d Jun 10 15:06:22.236203 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.236173 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:06:22.239129 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.239113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.241570 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241539 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bgknj\"" Jun 10 15:06:22.241687 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241545 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 15:06:22.241687 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241584 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 15:06:22.241687 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241546 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 15:06:22.241869 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241852 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 15:06:22.241869 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241859 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 15:06:22.241978 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 15:06:22.241978 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.241907 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 15:06:22.242072 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.242049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 15:06:22.242201 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.242185 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 15:06:22.258967 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.258944 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:06:22.360077 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.359985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360077 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-config-out\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360172 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7rl\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-kube-api-access-bk7rl\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360471 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360471 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-web-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360471 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.360471 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.360388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-web-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461636 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461681 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.461732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-config-out\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.462060 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.461734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.462141 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.462115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.462217 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.462165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.462277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.462219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7rl\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-kube-api-access-bk7rl\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.462277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.462253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.463631 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.463602 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.464190 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.464155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.464470 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.464452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.464544 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.464504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08dc6d89-b397-4d56-a603-11f2304321c8-config-out\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.464917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.464894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.465003 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.464925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.465213 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.465193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.465279 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.465251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.465356 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.465335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.465675 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.465653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.466215 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.466194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.466496 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.466482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08dc6d89-b397-4d56-a603-11f2304321c8-web-config\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.476098 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.476078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7rl\" (UniqueName: \"kubernetes.io/projected/08dc6d89-b397-4d56-a603-11f2304321c8-kube-api-access-bk7rl\") pod \"alertmanager-main-0\" (UID: \"08dc6d89-b397-4d56-a603-11f2304321c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.548273 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.548234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 15:06:22.686475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.686441 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 15:06:22.689742 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:22.689715 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dc6d89_b397_4d56_a603_11f2304321c8.slice/crio-50b34c20f2579cc47e74f38936866145fe7d1383a26bbbaf167d24133f9a87c7 WatchSource:0}: Error finding container 50b34c20f2579cc47e74f38936866145fe7d1383a26bbbaf167d24133f9a87c7: Status 404 returned error can't find the container with id 50b34c20f2579cc47e74f38936866145fe7d1383a26bbbaf167d24133f9a87c7 Jun 10 15:06:22.764823 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.764781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:22.767027 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.766997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d18aec2-9264-469a-a09f-7fa2c2c5144c-node-exporter-tls\") pod \"node-exporter-c7lkx\" (UID: \"7d18aec2-9264-469a-a09f-7fa2c2c5144c\") " pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:22.834724 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:22.834684 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7lkx" Jun 10 15:06:22.844032 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:22.844001 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d18aec2_9264_469a_a09f_7fa2c2c5144c.slice/crio-c02d3dd175622a56c6464ea19e77b440e189e8d4405cd7154ec4f2b4c30d1b20 WatchSource:0}: Error finding container c02d3dd175622a56c6464ea19e77b440e189e8d4405cd7154ec4f2b4c30d1b20: Status 404 returned error can't find the container with id c02d3dd175622a56c6464ea19e77b440e189e8d4405cd7154ec4f2b4c30d1b20 Jun 10 15:06:23.082820 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.082782 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7lkx" event={"ID":"7d18aec2-9264-469a-a09f-7fa2c2c5144c","Type":"ContainerStarted","Data":"c02d3dd175622a56c6464ea19e77b440e189e8d4405cd7154ec4f2b4c30d1b20"} Jun 10 15:06:23.084007 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.083968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" event={"ID":"d06dd82e-5cf3-4c41-831f-4cd0d0977a82","Type":"ContainerStarted","Data":"0f2f6b576cfc4ea9fe84807e6c41ed646f44e29ce0e9368c335205eea01dbe2d"} Jun 10 15:06:23.085195 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.085175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"50b34c20f2579cc47e74f38936866145fe7d1383a26bbbaf167d24133f9a87c7"} Jun 10 15:06:23.672729 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.672690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:06:23.675604 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.675553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd3d4fe4-985c-4f33-89c4-3da4995912f9-metrics-tls\") pod \"dns-default-7x775\" (UID: \"cd3d4fe4-985c-4f33-89c4-3da4995912f9\") " pod="openshift-dns/dns-default-7x775" Jun 10 15:06:23.974683 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.974650 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-982f9\"" Jun 10 15:06:23.982227 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:23.982198 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7x775" Jun 10 15:06:24.182957 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:24.182870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7x775"] Jun 10 15:06:24.188069 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:24.188033 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3d4fe4_985c_4f33_89c4_3da4995912f9.slice/crio-b2a2a9f8b54ee14081cbaaa9e3396a24dac59a639497566df9c90d3cc3a642ec WatchSource:0}: Error finding container b2a2a9f8b54ee14081cbaaa9e3396a24dac59a639497566df9c90d3cc3a642ec: Status 404 returned error can't find the container with id b2a2a9f8b54ee14081cbaaa9e3396a24dac59a639497566df9c90d3cc3a642ec Jun 10 15:06:25.094034 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.093996 2573 generic.go:356] "Generic (PLEG): container finished" podID="7d18aec2-9264-469a-a09f-7fa2c2c5144c" containerID="f1ba259bb57376956e776b1b214cfc743da36c34f4d179b3c214eb8f5940e705" exitCode=0 Jun 10 15:06:25.094236 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.094085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7lkx" event={"ID":"7d18aec2-9264-469a-a09f-7fa2c2c5144c","Type":"ContainerDied","Data":"f1ba259bb57376956e776b1b214cfc743da36c34f4d179b3c214eb8f5940e705"} Jun 10 15:06:25.095372 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.095346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7x775" event={"ID":"cd3d4fe4-985c-4f33-89c4-3da4995912f9","Type":"ContainerStarted","Data":"b2a2a9f8b54ee14081cbaaa9e3396a24dac59a639497566df9c90d3cc3a642ec"} Jun 10 15:06:25.097878 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.097853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" event={"ID":"d06dd82e-5cf3-4c41-831f-4cd0d0977a82","Type":"ContainerStarted","Data":"4370376c0d4042ce0d9087d2c3c8cd5dd5736e2311368045cdb210bfe0c8e738"} Jun 10 15:06:25.097976 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.097898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" event={"ID":"d06dd82e-5cf3-4c41-831f-4cd0d0977a82","Type":"ContainerStarted","Data":"e234ab6947eba973f16d0698005cb3d2195369433fa539183dfc90d5fff87b19"} Jun 10 15:06:25.097976 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.097921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" event={"ID":"d06dd82e-5cf3-4c41-831f-4cd0d0977a82","Type":"ContainerStarted","Data":"5ef8fa60dd1a8c6cce2c6d1cbd16485b9e1cdd89e8238dccd40a1c81ae733089"} Jun 10 15:06:25.099660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.099633 2573 generic.go:356] "Generic (PLEG): container finished" podID="08dc6d89-b397-4d56-a603-11f2304321c8" containerID="7ca40a4dd7610289d6dffaebfc9c0b093f67b2e2ccbba549b76494192e59db72" exitCode=0 Jun 10 15:06:25.099750 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.099677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerDied","Data":"7ca40a4dd7610289d6dffaebfc9c0b093f67b2e2ccbba549b76494192e59db72"} Jun 10 15:06:25.154022 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.153977 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-gzjxf" podStartSLOduration=2.531826216 podStartE2EDuration="4.153961273s" totalImagesPullingTime="1.622135057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:25.152851685 +0000 UTC m=+286.370618291" watchObservedRunningTime="2026-06-10 15:06:25.153961273 +0000 UTC m=+286.371727896" Jun 10 15:06:25.550878 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.550846 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5855c5655d-kzc4d"] Jun 10 15:06:25.554290 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.554266 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.556906 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.556855 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 15:06:25.557050 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.556972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zj22m\"" Jun 10 15:06:25.557153 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.557116 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 15:06:25.557272 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.557188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-btk62gnsnd1k8\"" Jun 10 15:06:25.557638 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.557620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 15:06:25.557726 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.557659 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 15:06:25.569982 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.569960 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5855c5655d-kzc4d"] Jun 10 15:06:25.693344 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0d819e7-455e-4b70-b329-2176173b448a-audit-log\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693513 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6fn\" (UniqueName: \"kubernetes.io/projected/d0d819e7-455e-4b70-b329-2176173b448a-kube-api-access-bt6fn\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693513 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693513 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-client-certs\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693677 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-client-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693677 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-metrics-server-audit-profiles\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.693677 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.693633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-tls\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794453 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0d819e7-455e-4b70-b329-2176173b448a-audit-log\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6fn\" (UniqueName: \"kubernetes.io/projected/d0d819e7-455e-4b70-b329-2176173b448a-kube-api-access-bt6fn\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-client-certs\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-client-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794670 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-metrics-server-audit-profiles\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794933 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-tls\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.794933 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.794903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d0d819e7-455e-4b70-b329-2176173b448a-audit-log\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.795394 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.795357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.795782 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.795735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d0d819e7-455e-4b70-b329-2176173b448a-metrics-server-audit-profiles\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.797778 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.797753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-client-certs\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.797923 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.797888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-secret-metrics-server-tls\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.798021 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.797930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0d819e7-455e-4b70-b329-2176173b448a-client-ca-bundle\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.805863 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.805783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6fn\" (UniqueName: \"kubernetes.io/projected/d0d819e7-455e-4b70-b329-2176173b448a-kube-api-access-bt6fn\") pod \"metrics-server-5855c5655d-kzc4d\" (UID: \"d0d819e7-455e-4b70-b329-2176173b448a\") " pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:25.864654 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:25.864615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:26.015413 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.015384 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5855c5655d-kzc4d"] Jun 10 15:06:26.019418 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:26.019383 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d819e7_455e_4b70_b329_2176173b448a.slice/crio-be6695976f6f2a4f6d57df4aba3468696e8387c4ae79c3c9804f6cf90c3d8641 WatchSource:0}: Error finding container be6695976f6f2a4f6d57df4aba3468696e8387c4ae79c3c9804f6cf90c3d8641: Status 404 returned error can't find the container with id be6695976f6f2a4f6d57df4aba3468696e8387c4ae79c3c9804f6cf90c3d8641 Jun 10 15:06:26.104993 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.104958 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" event={"ID":"d0d819e7-455e-4b70-b329-2176173b448a","Type":"ContainerStarted","Data":"be6695976f6f2a4f6d57df4aba3468696e8387c4ae79c3c9804f6cf90c3d8641"} Jun 10 15:06:26.106683 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.106652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7lkx" event={"ID":"7d18aec2-9264-469a-a09f-7fa2c2c5144c","Type":"ContainerStarted","Data":"f31e8a9d5d1a8916c5c5bc1867475fc318025d6f6e99b7af012f172e3b1011b3"} Jun 10 15:06:26.106824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.106701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7lkx" event={"ID":"7d18aec2-9264-469a-a09f-7fa2c2c5144c","Type":"ContainerStarted","Data":"ddc8b10f1c957867c8bb3797f53219eea47646f7a651d3c602070b010f62a40d"} Jun 10 15:06:26.108494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.108455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7x775" event={"ID":"cd3d4fe4-985c-4f33-89c4-3da4995912f9","Type":"ContainerStarted","Data":"7bbb9a03f0ce95ff7cba17e6873bbdee68a18d2e65e613ff8360d9c6a1d03f6c"} Jun 10 15:06:26.108626 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.108520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7x775" event={"ID":"cd3d4fe4-985c-4f33-89c4-3da4995912f9","Type":"ContainerStarted","Data":"6f0f90724518eebd511c071493e4ea8231d526a72471cac278c8c391338bcde7"} Jun 10 15:06:26.108626 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.108599 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7x775" Jun 10 15:06:26.138152 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.138104 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c7lkx" podStartSLOduration=4.794178369 podStartE2EDuration="6.138088888s" totalImagesPullingTime="1.235074198s" totalInitContainerRuntime="108.836321ms" isStatefulPod=true podCreationTimestamp="2026-06-10 15:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:26.136783323 +0000 UTC m=+287.354549927" watchObservedRunningTime="2026-06-10 15:06:26.138088888 +0000 UTC m=+287.355855489" Jun 10 15:06:26.290487 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.290435 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7x775" podStartSLOduration=251.597639663 podStartE2EDuration="4m13.290409323s" totalImagesPullingTime="1.69276966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:26.197094905 +0000 UTC m=+287.414861507" watchObservedRunningTime="2026-06-10 15:06:26.290409323 +0000 UTC m=+287.508175925" Jun 10 15:06:26.291680 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.291657 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6"] Jun 10 15:06:26.295343 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.295322 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.297961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.297939 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 15:06:26.298118 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.297985 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 15:06:26.298723 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.298693 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 15:06:26.298811 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.298699 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 15:06:26.298883 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.298699 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 15:06:26.298927 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.298699 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zgfw7\"" Jun 10 15:06:26.310390 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.310349 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 15:06:26.312879 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.312833 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6"] Jun 10 15:06:26.401684 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-serving-certs-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.401872 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.401872 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4km8k\" (UniqueName: \"kubernetes.io/projected/6438458d-a6bf-4a25-ad62-4938120ba211-kube-api-access-4km8k\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.401872 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-metrics-client-ca\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.401872 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.402057 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.402057 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-federate-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.402057 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.401932 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503343 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503529 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4km8k\" (UniqueName: \"kubernetes.io/projected/6438458d-a6bf-4a25-ad62-4938120ba211-kube-api-access-4km8k\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503529 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-metrics-client-ca\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503529 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503529 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503857 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-federate-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503950 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.503950 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.503932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-serving-certs-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.504267 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.504241 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-metrics-client-ca\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.504371 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.504310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.504634 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.504590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6438458d-a6bf-4a25-ad62-4938120ba211-serving-certs-ca-bundle\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.506355 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.506333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.506524 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.506504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-telemeter-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.506737 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.506717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.506737 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.506725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6438458d-a6bf-4a25-ad62-4938120ba211-federate-client-tls\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.512799 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.512777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4km8k\" (UniqueName: \"kubernetes.io/projected/6438458d-a6bf-4a25-ad62-4938120ba211-kube-api-access-4km8k\") pod \"telemeter-client-7d84b8c8c6-4p6c6\" (UID: \"6438458d-a6bf-4a25-ad62-4938120ba211\") " pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.607204 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.607116 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" Jun 10 15:06:26.769967 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:26.769935 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6"] Jun 10 15:06:26.773427 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:06:26.773401 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6438458d_a6bf_4a25_ad62_4938120ba211.slice/crio-b6d7a8216439bf778f2ad13113fdc7327c177dc4f5881bbe03a7f62c9b284da3 WatchSource:0}: Error finding container b6d7a8216439bf778f2ad13113fdc7327c177dc4f5881bbe03a7f62c9b284da3: Status 404 returned error can't find the container with id b6d7a8216439bf778f2ad13113fdc7327c177dc4f5881bbe03a7f62c9b284da3 Jun 10 15:06:27.113818 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:27.113771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" event={"ID":"6438458d-a6bf-4a25-ad62-4938120ba211","Type":"ContainerStarted","Data":"b6d7a8216439bf778f2ad13113fdc7327c177dc4f5881bbe03a7f62c9b284da3"} Jun 10 15:06:28.122180 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.122141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"2df86460a159883eb63e3186660247fe5dab7429e6644aaf4438e19708fcd32f"} Jun 10 15:06:28.122707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.122232 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"dba2b34b8af369dcb5b227fc2d063b696d9b259a3a05c8d21bd6f838a0f9531f"} Jun 10 15:06:28.122707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.122280 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"418380e5452fbaefe763e184b7e20057695f83a5732ce0115e668199a4dd8a8d"} Jun 10 15:06:28.122707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.122322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"211070a49e17ce59546628ee9a3981e919d46b8e0684d01275b8d26fa94966ea"} Jun 10 15:06:28.122707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.122360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"f892c1ede03cc02c23e6f26fbfb898d4dd77efa56d667061c9a2350c57b6c1e6"} Jun 10 15:06:28.123918 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.123889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" event={"ID":"d0d819e7-455e-4b70-b329-2176173b448a","Type":"ContainerStarted","Data":"4db4ca30f4c64ace74d6337ad4bf6ed6f32a84a830b700bc31ae810900e27467"} Jun 10 15:06:28.147845 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:28.147796 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" podStartSLOduration=1.443065826 podStartE2EDuration="3.147779728s" totalImagesPullingTime="1.704713902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:28.145597624 +0000 UTC m=+289.363364229" watchObservedRunningTime="2026-06-10 15:06:28.147779728 +0000 UTC m=+289.365546329" Jun 10 15:06:30.134228 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.134179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" event={"ID":"6438458d-a6bf-4a25-ad62-4938120ba211","Type":"ContainerStarted","Data":"36b3f1752a964eebcf5ef915db5bb64fce0f9e059b3431760db7193f22bfe9cb"} Jun 10 15:06:30.134688 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.134255 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" event={"ID":"6438458d-a6bf-4a25-ad62-4938120ba211","Type":"ContainerStarted","Data":"241fcee0fef620b6d5167452ff823d1e600275c1ed76dc124a84a8fe84d3d203"} Jun 10 15:06:30.134688 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.134283 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" event={"ID":"6438458d-a6bf-4a25-ad62-4938120ba211","Type":"ContainerStarted","Data":"f22b2dbf748b2b74108530f11d6ace6fb3c706546b716a6bf18ace838ab18daf"} Jun 10 15:06:30.137497 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.137468 2573 patch_prober.go:28] interesting pod/image-registry-84f7f9bd99-ckftc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 15:06:30.137657 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.137514 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" podUID="de9caf53-46d4-4878-96fe-ac8a762141b1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 15:06:30.138115 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.138092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"08dc6d89-b397-4d56-a603-11f2304321c8","Type":"ContainerStarted","Data":"7405d2d612e01f5b01114bba5b4ff9241837ebada38e36cbe5efac461a66aed2"} Jun 10 15:06:30.164104 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.164052 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d84b8c8c6-4p6c6" podStartSLOduration=1.699705626 podStartE2EDuration="4.164036054s" totalImagesPullingTime="2.464330428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:30.162702776 +0000 UTC m=+291.380469414" watchObservedRunningTime="2026-06-10 15:06:30.164036054 +0000 UTC m=+291.381802655" Jun 10 15:06:30.192998 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:30.192950 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.034890646 podStartE2EDuration="8.192932863s" totalImagesPullingTime="5.13353183s" totalInitContainerRuntime="24.510387ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:06:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:06:30.191848065 +0000 UTC m=+291.409614671" watchObservedRunningTime="2026-06-10 15:06:30.192932863 +0000 UTC m=+291.410699466" Jun 10 15:06:32.050945 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:32.050908 2573 patch_prober.go:28] interesting pod/image-registry-84f7f9bd99-ckftc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 15:06:32.051309 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:32.050957 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" podUID="de9caf53-46d4-4878-96fe-ac8a762141b1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 15:06:32.219814 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:06:32.219774 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nkzl6" podUID="52f5b41b-9ddb-4545-b0ae-af9db2b36edb" Jun 10 15:06:36.115870 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:36.115837 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7x775" Jun 10 15:06:39.183900 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:39.183875 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 15:06:40.135823 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:40.135794 2573 patch_prober.go:28] interesting pod/image-registry-84f7f9bd99-ckftc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 15:06:40.138054 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:40.135842 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" podUID="de9caf53-46d4-4878-96fe-ac8a762141b1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 15:06:42.050968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:42.050934 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84f7f9bd99-ckftc" Jun 10 15:06:43.218081 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:43.218052 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:06:45.864869 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:45.864827 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:45.865240 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:45.864896 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:06:46.195485 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:46.195401 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ac2b1de-45f2-44eb-b221-1b3c660cd3fb" containerID="88652aaad05642de255b0cf5011c5a07bb4c2c6c63611010f24cfd5b075459c8" exitCode=0 Jun 10 15:06:46.195485 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:46.195467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-krnfh" event={"ID":"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb","Type":"ContainerDied","Data":"88652aaad05642de255b0cf5011c5a07bb4c2c6c63611010f24cfd5b075459c8"} Jun 10 15:06:46.195811 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:46.195797 2573 scope.go:117] "RemoveContainer" containerID="88652aaad05642de255b0cf5011c5a07bb4c2c6c63611010f24cfd5b075459c8" Jun 10 15:06:46.487094 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:46.487040 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" podUID="68c9a827-c508-4970-b90f-f45306509df2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 15:06:47.200288 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:47.200254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-krnfh" event={"ID":"0ac2b1de-45f2-44eb-b221-1b3c660cd3fb","Type":"ContainerStarted","Data":"59161cd0e8060d4a3e3faaee0971514df1538666953808bead84629f317d7cf9"} Jun 10 15:06:47.395003 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:47.394978 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/init-config-reloader/0.log" Jun 10 15:06:47.599497 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:47.599467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/alertmanager/0.log" Jun 10 15:06:47.792951 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:47.792925 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/config-reloader/0.log" Jun 10 15:06:47.994410 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:47.994378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy-web/0.log" Jun 10 15:06:48.195773 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:48.195746 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy/0.log" Jun 10 15:06:48.400831 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:48.400765 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy-metric/0.log" Jun 10 15:06:48.594930 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:48.594897 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/prom-label-proxy/0.log" Jun 10 15:06:48.996767 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:48.996737 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-state-metrics/0.log" Jun 10 15:06:49.191912 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:49.191870 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-rbac-proxy-main/0.log" Jun 10 15:06:49.396717 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:49.396641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-rbac-proxy-self/0.log" Jun 10 15:06:49.594917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:49.594882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5855c5655d-kzc4d_d0d819e7-455e-4b70-b329-2176173b448a/metrics-server/0.log" Jun 10 15:06:50.591915 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:50.591891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/init-textfile/0.log" Jun 10 15:06:50.794225 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:50.794191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/node-exporter/0.log" Jun 10 15:06:51.006902 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:51.006872 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/kube-rbac-proxy/0.log" Jun 10 15:06:54.393506 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:54.393480 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/telemeter-client/0.log" Jun 10 15:06:54.591770 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:54.591745 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/reload/0.log" Jun 10 15:06:54.791730 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:54.791697 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/kube-rbac-proxy/0.log" Jun 10 15:06:56.487287 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:56.487247 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" podUID="68c9a827-c508-4970-b90f-f45306509df2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 15:06:57.792592 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:57.792546 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7x775_cd3d4fe4-985c-4f33-89c4-3da4995912f9/dns/0.log" Jun 10 15:06:57.992179 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:57.992150 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7x775_cd3d4fe4-985c-4f33-89c4-3da4995912f9/kube-rbac-proxy/0.log" Jun 10 15:06:59.395503 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:06:59.392381 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k74jx_5d25317a-5b82-40ba-883c-6e9f08e46323/dns-node-resolver/0.log" Jun 10 15:07:05.870001 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:05.869973 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:07:05.873903 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:05.873881 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5855c5655d-kzc4d" Jun 10 15:07:06.486942 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:06.486904 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" podUID="68c9a827-c508-4970-b90f-f45306509df2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 15:07:06.487104 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:06.486979 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" Jun 10 15:07:06.487436 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:06.487406 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c06647ef90387e1cce19c2e3870d9d3ed03afe4539c2f6a0a470e8a09aea685c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 15:07:06.487472 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:06.487455 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" podUID="68c9a827-c508-4970-b90f-f45306509df2" containerName="service-proxy" containerID="cri-o://c06647ef90387e1cce19c2e3870d9d3ed03afe4539c2f6a0a470e8a09aea685c" gracePeriod=30 Jun 10 15:07:07.275277 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:07.275248 2573 generic.go:356] "Generic (PLEG): container finished" podID="68c9a827-c508-4970-b90f-f45306509df2" containerID="c06647ef90387e1cce19c2e3870d9d3ed03afe4539c2f6a0a470e8a09aea685c" exitCode=2 Jun 10 15:07:07.275676 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:07.275320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerDied","Data":"c06647ef90387e1cce19c2e3870d9d3ed03afe4539c2f6a0a470e8a09aea685c"} Jun 10 15:07:07.275676 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:07.275364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5557b77fd7-tbzrj" event={"ID":"68c9a827-c508-4970-b90f-f45306509df2","Type":"ContainerStarted","Data":"f3d9c938de8d58b53f7ca86d94e693e3cfe463b682b37fef1fce6b81d8d4b028"} Jun 10 15:07:53.060920 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.060874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:07:53.063243 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.063222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52f5b41b-9ddb-4545-b0ae-af9db2b36edb-metrics-certs\") pod \"network-metrics-daemon-nkzl6\" (UID: \"52f5b41b-9ddb-4545-b0ae-af9db2b36edb\") " pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:07:53.121824 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.121795 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz4k2\"" Jun 10 15:07:53.129879 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.129855 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkzl6" Jun 10 15:07:53.259260 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.259230 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkzl6"] Jun 10 15:07:53.262105 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:07:53.262062 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f5b41b_9ddb_4545_b0ae_af9db2b36edb.slice/crio-8a232ece1b3c3380edd8b94c58526d7792525fb253913ca2a6026069222b9341 WatchSource:0}: Error finding container 8a232ece1b3c3380edd8b94c58526d7792525fb253913ca2a6026069222b9341: Status 404 returned error can't find the container with id 8a232ece1b3c3380edd8b94c58526d7792525fb253913ca2a6026069222b9341 Jun 10 15:07:53.264100 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.264084 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:07:53.439654 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:53.439568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkzl6" event={"ID":"52f5b41b-9ddb-4545-b0ae-af9db2b36edb","Type":"ContainerStarted","Data":"8a232ece1b3c3380edd8b94c58526d7792525fb253913ca2a6026069222b9341"} Jun 10 15:07:54.445468 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:54.445368 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkzl6" event={"ID":"52f5b41b-9ddb-4545-b0ae-af9db2b36edb","Type":"ContainerStarted","Data":"e806dcf1b167f049527f4fb8e347210e36030ffee35cebbcf7fa9a9ff013788b"} Jun 10 15:07:54.445468 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:54.445430 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkzl6" event={"ID":"52f5b41b-9ddb-4545-b0ae-af9db2b36edb","Type":"ContainerStarted","Data":"ae4fca73940e7299d0503fd84506af7aa6aa8b7b9120b68023795ae7aeae0322"} Jun 10 15:07:54.466100 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:07:54.466050 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nkzl6" podStartSLOduration=374.690957765 podStartE2EDuration="6m15.4660335s" totalImagesPullingTime="775.075735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:07:54.464751627 +0000 UTC m=+375.682518229" watchObservedRunningTime="2026-06-10 15:07:54.4660335 +0000 UTC m=+375.683800102" Jun 10 15:10:24.824795 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.824760 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg"] Jun 10 15:10:24.826939 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.826921 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:24.834324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.832746 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nhdqq\"" Jun 10 15:10:24.834324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.833011 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 15:10:24.834324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.833246 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 15:10:24.850593 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.850547 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg"] Jun 10 15:10:24.917959 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.917921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee08aceb-186c-443c-81e2-8d938f9b843b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:24.918132 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:24.918046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghh8j\" (UniqueName: \"kubernetes.io/projected/ee08aceb-186c-443c-81e2-8d938f9b843b-kube-api-access-ghh8j\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.019275 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.019233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee08aceb-186c-443c-81e2-8d938f9b843b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.019475 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.019349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghh8j\" (UniqueName: \"kubernetes.io/projected/ee08aceb-186c-443c-81e2-8d938f9b843b-kube-api-access-ghh8j\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.019653 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.019631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee08aceb-186c-443c-81e2-8d938f9b843b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.032744 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.032720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghh8j\" (UniqueName: \"kubernetes.io/projected/ee08aceb-186c-443c-81e2-8d938f9b843b-kube-api-access-ghh8j\") pod \"openshift-lws-operator-fd8ccff4c-wbxvg\" (UID: \"ee08aceb-186c-443c-81e2-8d938f9b843b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.141389 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.141296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" Jun 10 15:10:25.274655 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.274484 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg"] Jun 10 15:10:25.277233 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:10:25.277204 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee08aceb_186c_443c_81e2_8d938f9b843b.slice/crio-bf1623db7425d6b894e17bd4fb023b7fbd3f56ace63f515bb12b86375a7e2659 WatchSource:0}: Error finding container bf1623db7425d6b894e17bd4fb023b7fbd3f56ace63f515bb12b86375a7e2659: Status 404 returned error can't find the container with id bf1623db7425d6b894e17bd4fb023b7fbd3f56ace63f515bb12b86375a7e2659 Jun 10 15:10:25.992588 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:25.992538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" event={"ID":"ee08aceb-186c-443c-81e2-8d938f9b843b","Type":"ContainerStarted","Data":"bf1623db7425d6b894e17bd4fb023b7fbd3f56ace63f515bb12b86375a7e2659"} Jun 10 15:10:29.006427 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:29.006392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" event={"ID":"ee08aceb-186c-443c-81e2-8d938f9b843b","Type":"ContainerStarted","Data":"eba0982232327ed630c3d6dc5367f6cf43338a466cedfa34b8b525f4b94bf4aa"} Jun 10 15:10:29.031317 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:29.031258 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wbxvg" podStartSLOduration=2.103153621 podStartE2EDuration="5.031241083s" totalImagesPullingTime="2.928087462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:10:29.029629571 +0000 UTC m=+530.247396322" watchObservedRunningTime="2026-06-10 15:10:29.031241083 +0000 UTC m=+530.249007685" Jun 10 15:10:44.477551 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.477511 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j"] Jun 10 15:10:44.483015 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.482991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.486255 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.486229 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 15:10:44.486370 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.486280 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 15:10:44.486370 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.486357 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jmg8q\"" Jun 10 15:10:44.486491 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.486474 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 15:10:44.486695 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.486681 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 15:10:44.512901 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.512875 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j"] Jun 10 15:10:44.595743 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.595706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.595743 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.595743 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skz4z\" (UniqueName: \"kubernetes.io/projected/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-kube-api-access-skz4z\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.595961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.595773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.595961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.595842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-tmp\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.595961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.595901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-manifests\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696337 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-manifests\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696518 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696518 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696402 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skz4z\" (UniqueName: \"kubernetes.io/projected/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-kube-api-access-skz4z\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696518 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696518 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-tmp\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.696812 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.696790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-manifests\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.698776 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.698747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-tmp\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.698996 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.698977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.699089 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.699060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.706832 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.706806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skz4z\" (UniqueName: \"kubernetes.io/projected/ad3cf196-ec0d-4b3c-85f6-5399700bc5d3-kube-api-access-skz4z\") pod \"opendatahub-operator-controller-manager-58876c898f-x4w9j\" (UID: \"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3\") " pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.792890 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.792805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:44.925963 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:44.925896 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j"] Jun 10 15:10:44.929540 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:10:44.929518 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3cf196_ec0d_4b3c_85f6_5399700bc5d3.slice/crio-331cc97a5629f41c04b9320e46eaf9437d3de1ee83c0aba743fbfc68503bdd4d WatchSource:0}: Error finding container 331cc97a5629f41c04b9320e46eaf9437d3de1ee83c0aba743fbfc68503bdd4d: Status 404 returned error can't find the container with id 331cc97a5629f41c04b9320e46eaf9437d3de1ee83c0aba743fbfc68503bdd4d Jun 10 15:10:45.068060 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:45.067976 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" event={"ID":"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3","Type":"ContainerStarted","Data":"331cc97a5629f41c04b9320e46eaf9437d3de1ee83c0aba743fbfc68503bdd4d"} Jun 10 15:10:48.085943 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:48.085910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" event={"ID":"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3","Type":"ContainerStarted","Data":"7b8ff3fed3989bc4c14d7ad252c1251919a2a9f89cd15aa5b340761ff558ae26"} Jun 10 15:10:49.096221 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:49.096188 2573 generic.go:356] "Generic (PLEG): container finished" podID="ad3cf196-ec0d-4b3c-85f6-5399700bc5d3" containerID="7b8ff3fed3989bc4c14d7ad252c1251919a2a9f89cd15aa5b340761ff558ae26" exitCode=0 Jun 10 15:10:49.096630 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:49.096268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" event={"ID":"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3","Type":"ContainerDied","Data":"7b8ff3fed3989bc4c14d7ad252c1251919a2a9f89cd15aa5b340761ff558ae26"} Jun 10 15:10:50.102938 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:50.102906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" event={"ID":"ad3cf196-ec0d-4b3c-85f6-5399700bc5d3","Type":"ContainerStarted","Data":"1ea240452576467a16e8d52fba922d1b83af22c12d47a0d4009d2c45ed637cc6"} Jun 10 15:10:50.103345 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:50.103053 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:10:50.130273 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:10:50.130224 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" podStartSLOduration=1.83162983 podStartE2EDuration="6.130207867s" totalImagesPullingTime="3.310015794s" totalInitContainerRuntime="988.562243ms" isStatefulPod=false podCreationTimestamp="2026-06-10 15:10:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:10:50.130071388 +0000 UTC m=+551.347837992" watchObservedRunningTime="2026-06-10 15:10:50.130207867 +0000 UTC m=+551.347974468" Jun 10 15:11:01.108960 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:01.108925 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58876c898f-x4w9j" Jun 10 15:11:12.740716 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.740680 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm"] Jun 10 15:11:12.744050 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.744028 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.746709 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.746681 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9hgxs\"" Jun 10 15:11:12.746951 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.746936 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 15:11:12.747522 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.747506 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 15:11:12.751127 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.751102 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 15:11:12.758466 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.758446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm"] Jun 10 15:11:12.838653 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.838615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-metrics-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.838837 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.838665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be579e82-abcc-49ff-8eea-fd5e055472eb-manager-config\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.838837 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.838683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.838837 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.838735 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtvpn\" (UniqueName: \"kubernetes.io/projected/be579e82-abcc-49ff-8eea-fd5e055472eb-kube-api-access-gtvpn\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.939902 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.939863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtvpn\" (UniqueName: \"kubernetes.io/projected/be579e82-abcc-49ff-8eea-fd5e055472eb-kube-api-access-gtvpn\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.940095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.939935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-metrics-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.940095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.939963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be579e82-abcc-49ff-8eea-fd5e055472eb-manager-config\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.940095 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.939977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.940746 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.940715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be579e82-abcc-49ff-8eea-fd5e055472eb-manager-config\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.942324 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.942303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.942424 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.942406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be579e82-abcc-49ff-8eea-fd5e055472eb-metrics-cert\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:12.950646 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:12.950626 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtvpn\" (UniqueName: \"kubernetes.io/projected/be579e82-abcc-49ff-8eea-fd5e055472eb-kube-api-access-gtvpn\") pod \"lws-controller-manager-66bdc68598-v49rm\" (UID: \"be579e82-abcc-49ff-8eea-fd5e055472eb\") " pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:13.053670 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:13.053578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:13.190410 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:13.190320 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm"] Jun 10 15:11:13.193223 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:11:13.193195 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe579e82_abcc_49ff_8eea_fd5e055472eb.slice/crio-468e5a943d08e50b4116e171b7a9cb0ae2c89ce787c7769041608b12cd9ef296 WatchSource:0}: Error finding container 468e5a943d08e50b4116e171b7a9cb0ae2c89ce787c7769041608b12cd9ef296: Status 404 returned error can't find the container with id 468e5a943d08e50b4116e171b7a9cb0ae2c89ce787c7769041608b12cd9ef296 Jun 10 15:11:13.198472 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:13.198445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" event={"ID":"be579e82-abcc-49ff-8eea-fd5e055472eb","Type":"ContainerStarted","Data":"468e5a943d08e50b4116e171b7a9cb0ae2c89ce787c7769041608b12cd9ef296"} Jun 10 15:11:15.209740 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:15.209648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" event={"ID":"be579e82-abcc-49ff-8eea-fd5e055472eb","Type":"ContainerStarted","Data":"5426bedf75a3a8d66220601f27441ed9df7f7add1f5c4f99ee876c2434828417"} Jun 10 15:11:15.210109 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:15.209788 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:15.231927 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:15.231869 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" podStartSLOduration=1.635477997 podStartE2EDuration="3.231847203s" totalImagesPullingTime="1.596369206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:11:15.229744141 +0000 UTC m=+576.447510742" watchObservedRunningTime="2026-06-10 15:11:15.231847203 +0000 UTC m=+576.449613806" Jun 10 15:11:26.216366 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:26.216338 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66bdc68598-v49rm" Jun 10 15:11:56.845260 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.845219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf"] Jun 10 15:11:56.847354 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.847337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.849788 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.849762 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 15:11:56.850018 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.849875 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 15:11:56.850018 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.850009 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lfkzp\"" Jun 10 15:11:56.850201 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.850096 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 15:11:56.870249 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.870224 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf"] Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df7afbfe-d20e-4d22-80d2-722730901c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933314 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mz4l\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-kube-api-access-7mz4l\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:56.933807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:56.933547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034633 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034633 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df7afbfe-d20e-4d22-80d2-722730901c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034890 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034890 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034992 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034992 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mz4l\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-kube-api-access-7mz4l\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.034992 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.034968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035179 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035179 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035286 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035286 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035286 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035387 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df7afbfe-d20e-4d22-80d2-722730901c9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.035387 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.035360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.037330 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.037305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.037655 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.037635 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.047676 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.047651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mz4l\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-kube-api-access-7mz4l\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.054318 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.054297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df7afbfe-d20e-4d22-80d2-722730901c9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcdzvrf\" (UID: \"df7afbfe-d20e-4d22-80d2-722730901c9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.157376 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.157290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:11:57.302469 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.302444 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf"] Jun 10 15:11:57.304945 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:11:57.304915 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7afbfe_d20e_4d22_80d2_722730901c9d.slice/crio-85822ebef8756bbad4f5bafb30922604a7032ae3311e7517ae5bb69ab7c7e78b WatchSource:0}: Error finding container 85822ebef8756bbad4f5bafb30922604a7032ae3311e7517ae5bb69ab7c7e78b: Status 404 returned error can't find the container with id 85822ebef8756bbad4f5bafb30922604a7032ae3311e7517ae5bb69ab7c7e78b Jun 10 15:11:57.386426 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:11:57.386391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" event={"ID":"df7afbfe-d20e-4d22-80d2-722730901c9d","Type":"ContainerStarted","Data":"85822ebef8756bbad4f5bafb30922604a7032ae3311e7517ae5bb69ab7c7e78b"} Jun 10 15:12:01.235138 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.235061 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6f5db44995-7nmbf"] Jun 10 15:12:01.237137 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.237122 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.239889 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.239843 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 15:12:01.240031 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.240013 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hq7v4\"" Jun 10 15:12:01.246959 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.246937 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6f5db44995-7nmbf"] Jun 10 15:12:01.374660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.374622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/053fe3f7-989f-4b2c-adb8-77423afe76d2-redirect-config\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.374850 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.374679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r28l7\" (UniqueName: \"kubernetes.io/projected/053fe3f7-989f-4b2c-adb8-77423afe76d2-kube-api-access-r28l7\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.475839 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.475808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/053fe3f7-989f-4b2c-adb8-77423afe76d2-redirect-config\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.475992 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.475858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r28l7\" (UniqueName: \"kubernetes.io/projected/053fe3f7-989f-4b2c-adb8-77423afe76d2-kube-api-access-r28l7\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.476525 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.476495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/053fe3f7-989f-4b2c-adb8-77423afe76d2-redirect-config\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.489806 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.489733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r28l7\" (UniqueName: \"kubernetes.io/projected/053fe3f7-989f-4b2c-adb8-77423afe76d2-kube-api-access-r28l7\") pod \"dashboard-redirect-6f5db44995-7nmbf\" (UID: \"053fe3f7-989f-4b2c-adb8-77423afe76d2\") " pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:01.547598 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:01.547553 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" Jun 10 15:12:02.434673 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:02.434608 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:12:02.435039 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:02.434705 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:12:02.435039 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:02.434736 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:12:02.523740 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:02.523709 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6f5db44995-7nmbf"] Jun 10 15:12:02.527498 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:12:02.527469 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053fe3f7_989f_4b2c_adb8_77423afe76d2.slice/crio-770cb531a960a621a908f914043f55b8a108ef27b410516ed8f28ff14179b43c WatchSource:0}: Error finding container 770cb531a960a621a908f914043f55b8a108ef27b410516ed8f28ff14179b43c: Status 404 returned error can't find the container with id 770cb531a960a621a908f914043f55b8a108ef27b410516ed8f28ff14179b43c Jun 10 15:12:03.419340 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:03.419303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" event={"ID":"df7afbfe-d20e-4d22-80d2-722730901c9d","Type":"ContainerStarted","Data":"1ecd04598ede978cff4281c9a833e020c272491dc8be2aaa631a9ddd1d299757"} Jun 10 15:12:03.421139 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:03.421107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" event={"ID":"053fe3f7-989f-4b2c-adb8-77423afe76d2","Type":"ContainerStarted","Data":"770cb531a960a621a908f914043f55b8a108ef27b410516ed8f28ff14179b43c"} Jun 10 15:12:03.445210 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:03.445147 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" podStartSLOduration=2.317727613 podStartE2EDuration="7.445123624s" totalImagesPullingTime="5.127396011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:12:03.442068057 +0000 UTC m=+624.659834659" watchObservedRunningTime="2026-06-10 15:12:03.445123624 +0000 UTC m=+624.662890235" Jun 10 15:12:04.158349 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:04.158311 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:12:04.165061 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:04.165039 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:12:04.427110 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:04.427022 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:12:04.428242 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:04.428213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcdzvrf" Jun 10 15:12:06.511608 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.511579 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:06.514294 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.514271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:06.516437 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.516417 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 15:12:06.517142 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.517124 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6wbw4\"" Jun 10 15:12:06.517228 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.517154 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 15:12:06.526380 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.526354 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:06.628921 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.628887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gnd\" (UniqueName: \"kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd\") pod \"kuadrant-operator-catalog-sdw9s\" (UID: \"62cd1d75-1c8c-4009-9c0c-c34c795d95c1\") " pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:06.730362 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.730326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gnd\" (UniqueName: \"kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd\") pod \"kuadrant-operator-catalog-sdw9s\" (UID: \"62cd1d75-1c8c-4009-9c0c-c34c795d95c1\") " pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:06.740346 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.740316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gnd\" (UniqueName: \"kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd\") pod \"kuadrant-operator-catalog-sdw9s\" (UID: \"62cd1d75-1c8c-4009-9c0c-c34c795d95c1\") " pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:06.826981 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.826896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:06.862681 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.862646 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:06.957330 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:06.957306 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:06.959859 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:12:06.959827 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cd1d75_1c8c_4009_9c0c_c34c795d95c1.slice/crio-76362ed34ac461686ac9ef60c4cc5fb9e796dfdeca91738742f188d164a0962e WatchSource:0}: Error finding container 76362ed34ac461686ac9ef60c4cc5fb9e796dfdeca91738742f188d164a0962e: Status 404 returned error can't find the container with id 76362ed34ac461686ac9ef60c4cc5fb9e796dfdeca91738742f188d164a0962e Jun 10 15:12:07.079771 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.079692 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td2pn"] Jun 10 15:12:07.085505 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.084231 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:07.092170 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.092139 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td2pn"] Jun 10 15:12:07.235084 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.235056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktks\" (UniqueName: \"kubernetes.io/projected/ce638b44-5e95-4fee-a29a-f9fe7bf8ff24-kube-api-access-zktks\") pod \"kuadrant-operator-catalog-td2pn\" (UID: \"ce638b44-5e95-4fee-a29a-f9fe7bf8ff24\") " pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:07.336144 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.336058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktks\" (UniqueName: \"kubernetes.io/projected/ce638b44-5e95-4fee-a29a-f9fe7bf8ff24-kube-api-access-zktks\") pod \"kuadrant-operator-catalog-td2pn\" (UID: \"ce638b44-5e95-4fee-a29a-f9fe7bf8ff24\") " pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:07.346336 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.346298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktks\" (UniqueName: \"kubernetes.io/projected/ce638b44-5e95-4fee-a29a-f9fe7bf8ff24-kube-api-access-zktks\") pod \"kuadrant-operator-catalog-td2pn\" (UID: \"ce638b44-5e95-4fee-a29a-f9fe7bf8ff24\") " pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:07.396319 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.396279 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:07.442436 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.442377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" event={"ID":"62cd1d75-1c8c-4009-9c0c-c34c795d95c1","Type":"ContainerStarted","Data":"76362ed34ac461686ac9ef60c4cc5fb9e796dfdeca91738742f188d164a0962e"} Jun 10 15:12:07.547393 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:07.547356 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td2pn"] Jun 10 15:12:07.549985 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:12:07.549958 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce638b44_5e95_4fee_a29a_f9fe7bf8ff24.slice/crio-5a9d39fd6efa0d32596235f4cebbe7312d1af2f1b769dfa0ec1e11b0a6d721e2 WatchSource:0}: Error finding container 5a9d39fd6efa0d32596235f4cebbe7312d1af2f1b769dfa0ec1e11b0a6d721e2: Status 404 returned error can't find the container with id 5a9d39fd6efa0d32596235f4cebbe7312d1af2f1b769dfa0ec1e11b0a6d721e2 Jun 10 15:12:08.448639 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:08.448602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" event={"ID":"ce638b44-5e95-4fee-a29a-f9fe7bf8ff24","Type":"ContainerStarted","Data":"5a9d39fd6efa0d32596235f4cebbe7312d1af2f1b769dfa0ec1e11b0a6d721e2"} Jun 10 15:12:10.458731 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.458687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" event={"ID":"ce638b44-5e95-4fee-a29a-f9fe7bf8ff24","Type":"ContainerStarted","Data":"12bedcd9c08fec9a4841fb3e4a30ece20520e29d438f0fade669554683ea19cd"} Jun 10 15:12:10.460089 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.460059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" event={"ID":"62cd1d75-1c8c-4009-9c0c-c34c795d95c1","Type":"ContainerStarted","Data":"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517"} Jun 10 15:12:10.460214 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.460145 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" podUID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" containerName="registry-server" containerID="cri-o://b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517" gracePeriod=2 Jun 10 15:12:10.478132 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.478091 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" podStartSLOduration=1.589141722 podStartE2EDuration="3.478076798s" totalImagesPullingTime="1.888935076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:12:10.476849011 +0000 UTC m=+631.694615645" watchObservedRunningTime="2026-06-10 15:12:10.478076798 +0000 UTC m=+631.695843399" Jun 10 15:12:10.495246 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.495183 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" podStartSLOduration=2.012583135 podStartE2EDuration="4.495164935s" totalImagesPullingTime="2.4825818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:12:10.494822469 +0000 UTC m=+631.712589091" watchObservedRunningTime="2026-06-10 15:12:10.495164935 +0000 UTC m=+631.712931538" Jun 10 15:12:10.710405 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.710347 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:10.768017 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.767989 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8gnd\" (UniqueName: \"kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd\") pod \"62cd1d75-1c8c-4009-9c0c-c34c795d95c1\" (UID: \"62cd1d75-1c8c-4009-9c0c-c34c795d95c1\") " Jun 10 15:12:10.770173 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.770143 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd" (OuterVolumeSpecName: "kube-api-access-z8gnd") pod "62cd1d75-1c8c-4009-9c0c-c34c795d95c1" (UID: "62cd1d75-1c8c-4009-9c0c-c34c795d95c1"). InnerVolumeSpecName "kube-api-access-z8gnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:12:10.868955 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:10.868919 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8gnd\" (UniqueName: \"kubernetes.io/projected/62cd1d75-1c8c-4009-9c0c-c34c795d95c1-kube-api-access-z8gnd\") on node \"ip-10-0-141-243.ec2.internal\" DevicePath \"\"" Jun 10 15:12:11.466546 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.466512 2573 generic.go:356] "Generic (PLEG): container finished" podID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" containerID="b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517" exitCode=0 Jun 10 15:12:11.466971 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.466576 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" Jun 10 15:12:11.466971 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.466601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" event={"ID":"62cd1d75-1c8c-4009-9c0c-c34c795d95c1","Type":"ContainerDied","Data":"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517"} Jun 10 15:12:11.466971 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.466654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sdw9s" event={"ID":"62cd1d75-1c8c-4009-9c0c-c34c795d95c1","Type":"ContainerDied","Data":"76362ed34ac461686ac9ef60c4cc5fb9e796dfdeca91738742f188d164a0962e"} Jun 10 15:12:11.466971 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.466680 2573 scope.go:117] "RemoveContainer" containerID="b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517" Jun 10 15:12:11.486171 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.486101 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:11.490480 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.490456 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sdw9s"] Jun 10 15:12:11.999489 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.999465 2573 scope.go:117] "RemoveContainer" containerID="b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517" Jun 10 15:12:11.999849 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:12:11.999821 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517\": container with ID starting with b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517 not found: ID does not exist" containerID="b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517" Jun 10 15:12:11.999930 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:11.999860 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517"} err="failed to get container status \"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517\": rpc error: code = NotFound desc = could not find container \"b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517\": container with ID starting with b9f74a76710ac1488125ffeb0e19075da3994ed0ec5ad490c4a0716a7a405517 not found: ID does not exist" Jun 10 15:12:12.472547 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:12.472513 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" event={"ID":"053fe3f7-989f-4b2c-adb8-77423afe76d2","Type":"ContainerStarted","Data":"779c33a2f8fae7b2aebca0fd4550732d5fb39647a9615f0479e734bc43741630"} Jun 10 15:12:12.490946 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:12.490901 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6f5db44995-7nmbf" podStartSLOduration=1.9571947920000001 podStartE2EDuration="11.490887831s" totalImagesPullingTime="9.533693039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:12:12.490681856 +0000 UTC m=+633.708448460" watchObservedRunningTime="2026-06-10 15:12:12.490887831 +0000 UTC m=+633.708654432" Jun 10 15:12:13.222972 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:13.222940 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" path="/var/lib/kubelet/pods/62cd1d75-1c8c-4009-9c0c-c34c795d95c1/volumes" Jun 10 15:12:17.397197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:17.397153 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:17.397638 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:17.397221 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:17.419493 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:17.419466 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:17.515540 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:17.515514 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-td2pn" Jun 10 15:12:38.656820 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.656782 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-62xn5"] Jun 10 15:12:38.657406 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.657255 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" containerName="registry-server" Jun 10 15:12:38.657406 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.657275 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" containerName="registry-server" Jun 10 15:12:38.657406 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.657353 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="62cd1d75-1c8c-4009-9c0c-c34c795d95c1" containerName="registry-server" Jun 10 15:12:38.676505 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.676472 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:38.678959 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.678933 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kdkp2\"" Jun 10 15:12:38.679194 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.679174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-62xn5"] Jun 10 15:12:38.822742 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.822706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l42sh\" (UniqueName: \"kubernetes.io/projected/09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c-kube-api-access-l42sh\") pod \"authorino-operator-75cc8d5cb7-62xn5\" (UID: \"09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:38.924083 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.924004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l42sh\" (UniqueName: \"kubernetes.io/projected/09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c-kube-api-access-l42sh\") pod \"authorino-operator-75cc8d5cb7-62xn5\" (UID: \"09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:38.939304 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.939269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l42sh\" (UniqueName: \"kubernetes.io/projected/09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c-kube-api-access-l42sh\") pod \"authorino-operator-75cc8d5cb7-62xn5\" (UID: \"09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:38.988165 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:38.988126 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:39.123116 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:39.123032 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-62xn5"] Jun 10 15:12:39.125646 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:12:39.125551 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09bd3fd2_1c95_44f3_9ae4_6c79d4a1a57c.slice/crio-997602eaa655017983f9f2faba80cba5578e18359740a093286c881e6b1518ba WatchSource:0}: Error finding container 997602eaa655017983f9f2faba80cba5578e18359740a093286c881e6b1518ba: Status 404 returned error can't find the container with id 997602eaa655017983f9f2faba80cba5578e18359740a093286c881e6b1518ba Jun 10 15:12:39.588639 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:39.588596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" event={"ID":"09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c","Type":"ContainerStarted","Data":"997602eaa655017983f9f2faba80cba5578e18359740a093286c881e6b1518ba"} Jun 10 15:12:42.604674 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:42.604635 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" event={"ID":"09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c","Type":"ContainerStarted","Data":"d5f8d212b35b78315e1f5c245628720fb8647c8d8229bcbbb53ccbadf02cd614"} Jun 10 15:12:42.605083 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:42.604711 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:42.645630 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:42.645555 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" podStartSLOduration=1.809289669 podStartE2EDuration="4.645535676s" totalImagesPullingTime="2.836246007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:12:42.644161226 +0000 UTC m=+663.861927839" watchObservedRunningTime="2026-06-10 15:12:42.645535676 +0000 UTC m=+663.863302277" Jun 10 15:12:53.610793 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:53.610757 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-62xn5" Jun 10 15:12:55.438262 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.438225 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll"] Jun 10 15:12:55.440590 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.440552 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.477393 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.477357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshln\" (UniqueName: \"kubernetes.io/projected/e88288fa-933f-4671-a6b8-b782f1f8010f-kube-api-access-dshln\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.477540 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.477433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.477540 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.477467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e88288fa-933f-4671-a6b8-b782f1f8010f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.486997 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.486973 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 15:12:55.487128 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.486975 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 15:12:55.487334 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.487319 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wncc\"" Jun 10 15:12:55.548427 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.548397 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll"] Jun 10 15:12:55.578760 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.578729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.578923 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.578782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e88288fa-933f-4671-a6b8-b782f1f8010f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.578923 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.578856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshln\" (UniqueName: \"kubernetes.io/projected/e88288fa-933f-4671-a6b8-b782f1f8010f-kube-api-access-dshln\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.578923 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:12:55.578886 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 15:12:55.579080 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:12:55.578953 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert podName:e88288fa-933f-4671-a6b8-b782f1f8010f nodeName:}" failed. No retries permitted until 2026-06-10 15:12:56.078931184 +0000 UTC m=+677.296697766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-r68ll" (UID: "e88288fa-933f-4671-a6b8-b782f1f8010f") : secret "plugin-serving-cert" not found Jun 10 15:12:55.579491 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.579472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e88288fa-933f-4671-a6b8-b782f1f8010f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:55.613172 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:55.613145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshln\" (UniqueName: \"kubernetes.io/projected/e88288fa-933f-4671-a6b8-b782f1f8010f-kube-api-access-dshln\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:56.088590 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:56.084973 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:56.088590 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:12:56.085257 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 15:12:56.088590 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:12:56.085334 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert podName:e88288fa-933f-4671-a6b8-b782f1f8010f nodeName:}" failed. No retries permitted until 2026-06-10 15:12:57.085314061 +0000 UTC m=+678.303080660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-r68ll" (UID: "e88288fa-933f-4671-a6b8-b782f1f8010f") : secret "plugin-serving-cert" not found Jun 10 15:12:57.094384 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.094338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:57.096797 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.096775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e88288fa-933f-4671-a6b8-b782f1f8010f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r68ll\" (UID: \"e88288fa-933f-4671-a6b8-b782f1f8010f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:57.249254 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.249225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" Jun 10 15:12:57.390653 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.390599 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll"] Jun 10 15:12:57.393206 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:12:57.393172 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88288fa_933f_4671_a6b8_b782f1f8010f.slice/crio-2cf64b3c8c3c3fffe2f330513d5dd5b3f270d005349f2982df8ee9d1f8ba6418 WatchSource:0}: Error finding container 2cf64b3c8c3c3fffe2f330513d5dd5b3f270d005349f2982df8ee9d1f8ba6418: Status 404 returned error can't find the container with id 2cf64b3c8c3c3fffe2f330513d5dd5b3f270d005349f2982df8ee9d1f8ba6418 Jun 10 15:12:57.394696 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.394678 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:12:57.672074 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:12:57.671977 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" event={"ID":"e88288fa-933f-4671-a6b8-b782f1f8010f","Type":"ContainerStarted","Data":"2cf64b3c8c3c3fffe2f330513d5dd5b3f270d005349f2982df8ee9d1f8ba6418"} Jun 10 15:13:05.696291 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.696257 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn"] Jun 10 15:13:05.699395 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.699373 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.701995 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.701972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9zgmq\"" Jun 10 15:13:05.714611 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.714581 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn"] Jun 10 15:13:05.781901 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.781867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ddr\" (UniqueName: \"kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.782063 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.781906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.883408 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.883375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ddr\" (UniqueName: \"kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.883597 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.883417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.883825 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.883808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.906430 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.906403 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ddr\" (UniqueName: \"kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr\") pod \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.986572 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.986537 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn"] Jun 10 15:13:05.986818 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.986803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:05.991887 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:05.991855 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn"] Jun 10 15:13:06.078814 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.078780 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:06.081666 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.081640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.106688 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.106478 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:06.186200 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.186170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.186362 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.186215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcw5h\" (UniqueName: \"kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.286795 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.286706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.286795 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.286776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcw5h\" (UniqueName: \"kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.287188 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.287157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.307045 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.307015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcw5h\" (UniqueName: \"kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h\") pod \"kuadrant-operator-controller-manager-55467d9f7-6c2qq\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.396040 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.396009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:06.546041 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.546012 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:06.548008 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:13:06.547970 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e38009e_99f2_421a_9765_03d14cf23911.slice/crio-ad7d12ff7c14827197bc6df544c206db3a5e0e869a49daf22aab46e20ea22a1d WatchSource:0}: Error finding container ad7d12ff7c14827197bc6df544c206db3a5e0e869a49daf22aab46e20ea22a1d: Status 404 returned error can't find the container with id ad7d12ff7c14827197bc6df544c206db3a5e0e869a49daf22aab46e20ea22a1d Jun 10 15:13:06.718267 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:06.718230 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" event={"ID":"5e38009e-99f2-421a-9765-03d14cf23911","Type":"ContainerStarted","Data":"ad7d12ff7c14827197bc6df544c206db3a5e0e869a49daf22aab46e20ea22a1d"} Jun 10 15:13:22.822804 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:22.822542 2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fdgxn_kuadrant-system_484dfcda-2e5a-4285-b0a9-42af664c39b9_0(754d90c06fc943fbca81891ab20258563aa150821d9bd9e5810353287bda0d1b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fdgxn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 10 15:13:22.822804 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:22.822622 2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fdgxn_kuadrant-system_484dfcda-2e5a-4285-b0a9-42af664c39b9_0(754d90c06fc943fbca81891ab20258563aa150821d9bd9e5810353287bda0d1b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fdgxn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:23.815224 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.815171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" event={"ID":"e88288fa-933f-4671-a6b8-b782f1f8010f","Type":"ContainerStarted","Data":"9a90117c1aa3959636b3023781c22353f64def0f89a5bb25faac61ab11fee111"} Jun 10 15:13:23.816655 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.816632 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" event={"ID":"5e38009e-99f2-421a-9765-03d14cf23911","Type":"ContainerStarted","Data":"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a"} Jun 10 15:13:23.816762 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.816638 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:23.816816 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.816764 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:23.823076 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.823053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:23.833419 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.833367 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r68ll" podStartSLOduration=3.369790548 podStartE2EDuration="28.833349465s" totalImagesPullingTime="25.463558917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:13:23.832959528 +0000 UTC m=+705.050726133" watchObservedRunningTime="2026-06-10 15:13:23.833349465 +0000 UTC m=+705.051116068" Jun 10 15:13:23.834884 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:23.834855 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" is forbidden: User \"system:node:ip-10-0-141-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-243.ec2.internal' and this object" podUID="484dfcda-2e5a-4285-b0a9-42af664c39b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:23.859842 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.859792 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" podStartSLOduration=1.571169992 podStartE2EDuration="17.859770487s" totalImagesPullingTime="16.288600495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:13:23.857798359 +0000 UTC m=+705.075564993" watchObservedRunningTime="2026-06-10 15:13:23.859770487 +0000 UTC m=+705.077537088" Jun 10 15:13:23.958954 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.958925 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume\") pod \"484dfcda-2e5a-4285-b0a9-42af664c39b9\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " Jun 10 15:13:23.959120 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.958996 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ddr\" (UniqueName: \"kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr\") pod \"484dfcda-2e5a-4285-b0a9-42af664c39b9\" (UID: \"484dfcda-2e5a-4285-b0a9-42af664c39b9\") " Jun 10 15:13:23.959260 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.959230 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "484dfcda-2e5a-4285-b0a9-42af664c39b9" (UID: "484dfcda-2e5a-4285-b0a9-42af664c39b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:13:23.961178 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:23.961152 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr" (OuterVolumeSpecName: "kube-api-access-v2ddr") pod "484dfcda-2e5a-4285-b0a9-42af664c39b9" (UID: "484dfcda-2e5a-4285-b0a9-42af664c39b9"). InnerVolumeSpecName "kube-api-access-v2ddr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:13:24.059682 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:24.059651 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ddr\" (UniqueName: \"kubernetes.io/projected/484dfcda-2e5a-4285-b0a9-42af664c39b9-kube-api-access-v2ddr\") on node \"ip-10-0-141-243.ec2.internal\" DevicePath \"\"" Jun 10 15:13:24.059682 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:24.059676 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484dfcda-2e5a-4285-b0a9-42af664c39b9-extensions-socket-volume\") on node \"ip-10-0-141-243.ec2.internal\" DevicePath \"\"" Jun 10 15:13:24.821162 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:24.821131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:24.823372 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:24.823342 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" is forbidden: User \"system:node:ip-10-0-141-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-243.ec2.internal' and this object" podUID="484dfcda-2e5a-4285-b0a9-42af664c39b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:24.828914 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:24.828886 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fdgxn\" is forbidden: User \"system:node:ip-10-0-141-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-243.ec2.internal' and this object" podUID="484dfcda-2e5a-4285-b0a9-42af664c39b9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fdgxn" Jun 10 15:13:25.223733 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:25.223697 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484dfcda-2e5a-4285-b0a9-42af664c39b9" path="/var/lib/kubelet/pods/484dfcda-2e5a-4285-b0a9-42af664c39b9/volumes" Jun 10 15:13:34.823425 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:34.823393 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:47.514400 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.514360 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:47.515157 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.515085 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" podUID="5e38009e-99f2-421a-9765-03d14cf23911" containerName="manager" containerID="cri-o://7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a" gracePeriod=10 Jun 10 15:13:47.881880 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.881852 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:47.921648 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.921613 2573 generic.go:356] "Generic (PLEG): container finished" podID="5e38009e-99f2-421a-9765-03d14cf23911" containerID="7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a" exitCode=0 Jun 10 15:13:47.921812 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.921669 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" Jun 10 15:13:47.921812 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.921699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" event={"ID":"5e38009e-99f2-421a-9765-03d14cf23911","Type":"ContainerDied","Data":"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a"} Jun 10 15:13:47.921812 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.921757 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq" event={"ID":"5e38009e-99f2-421a-9765-03d14cf23911","Type":"ContainerDied","Data":"ad7d12ff7c14827197bc6df544c206db3a5e0e869a49daf22aab46e20ea22a1d"} Jun 10 15:13:47.921812 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.921780 2573 scope.go:117] "RemoveContainer" containerID="7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a" Jun 10 15:13:47.930209 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.930192 2573 scope.go:117] "RemoveContainer" containerID="7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a" Jun 10 15:13:47.930498 ip-10-0-141-243 kubenswrapper[2573]: E0610 15:13:47.930481 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a\": container with ID starting with 7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a not found: ID does not exist" containerID="7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a" Jun 10 15:13:47.930555 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.930508 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a"} err="failed to get container status \"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a\": rpc error: code = NotFound desc = could not find container \"7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a\": container with ID starting with 7c4aaf3daba67ef1fe12245b829bcf19eeff7537ef9a0652789d2425de67562a not found: ID does not exist" Jun 10 15:13:47.974410 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.974381 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcw5h\" (UniqueName: \"kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h\") pod \"5e38009e-99f2-421a-9765-03d14cf23911\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " Jun 10 15:13:47.974540 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.974481 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume\") pod \"5e38009e-99f2-421a-9765-03d14cf23911\" (UID: \"5e38009e-99f2-421a-9765-03d14cf23911\") " Jun 10 15:13:47.974845 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.974821 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e38009e-99f2-421a-9765-03d14cf23911" (UID: "5e38009e-99f2-421a-9765-03d14cf23911"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 15:13:47.976453 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:47.976411 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h" (OuterVolumeSpecName: "kube-api-access-tcw5h") pod "5e38009e-99f2-421a-9765-03d14cf23911" (UID: "5e38009e-99f2-421a-9765-03d14cf23911"). InnerVolumeSpecName "kube-api-access-tcw5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 15:13:48.075951 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:48.075869 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcw5h\" (UniqueName: \"kubernetes.io/projected/5e38009e-99f2-421a-9765-03d14cf23911-kube-api-access-tcw5h\") on node \"ip-10-0-141-243.ec2.internal\" DevicePath \"\"" Jun 10 15:13:48.075951 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:48.075899 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e38009e-99f2-421a-9765-03d14cf23911-extensions-socket-volume\") on node \"ip-10-0-141-243.ec2.internal\" DevicePath \"\"" Jun 10 15:13:48.251172 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:48.251137 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:48.256340 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:48.256316 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6c2qq"] Jun 10 15:13:49.223360 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:49.223329 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e38009e-99f2-421a-9765-03d14cf23911" path="/var/lib/kubelet/pods/5e38009e-99f2-421a-9765-03d14cf23911/volumes" Jun 10 15:13:51.477219 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.477187 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c"] Jun 10 15:13:51.477603 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.477588 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e38009e-99f2-421a-9765-03d14cf23911" containerName="manager" Jun 10 15:13:51.477660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.477605 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e38009e-99f2-421a-9765-03d14cf23911" containerName="manager" Jun 10 15:13:51.477697 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.477660 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e38009e-99f2-421a-9765-03d14cf23911" containerName="manager" Jun 10 15:13:51.586197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.586159 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c"] Jun 10 15:13:51.586378 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.586289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.588750 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.588719 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xghdp\"" Jun 10 15:13:51.711850 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.711810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.711850 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.711852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712051 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.711870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712051 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.711965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712051 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.711994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712051 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.712029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xz2\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-kube-api-access-f2xz2\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712178 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.712069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712178 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.712105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.712178 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.712120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813514 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813514 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813514 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xz2\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-kube-api-access-f2xz2\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.813821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.814121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.814121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.813996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.814121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.814082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.814278 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.814156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.814494 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.814472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.815867 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.815840 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.815980 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.815963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.822961 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.822937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.823072 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.823013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xz2\" (UniqueName: \"kubernetes.io/projected/4ad9c562-4e3b-44f1-85e2-3f0c6619b047-kube-api-access-f2xz2\") pod \"maas-default-gateway-openshift-default-8559cd5744-s658c\" (UID: \"4ad9c562-4e3b-44f1-85e2-3f0c6619b047\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:51.896787 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:51.896751 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:52.066357 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.066333 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c"] Jun 10 15:13:52.068205 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:13:52.068173 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad9c562_4e3b_44f1_85e2_3f0c6619b047.slice/crio-eba4532cd1d3d18ad5c33394215d6ffd8c24c487bb0ee672e83e056cd9dcecd2 WatchSource:0}: Error finding container eba4532cd1d3d18ad5c33394215d6ffd8c24c487bb0ee672e83e056cd9dcecd2: Status 404 returned error can't find the container with id eba4532cd1d3d18ad5c33394215d6ffd8c24c487bb0ee672e83e056cd9dcecd2 Jun 10 15:13:52.070477 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.070446 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:13:52.070603 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.070524 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:13:52.070603 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.070590 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:13:52.953426 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.953387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" event={"ID":"4ad9c562-4e3b-44f1-85e2-3f0c6619b047","Type":"ContainerStarted","Data":"3eef88744203a61abbdf0f6e6f3d12e9a556399f91b5287d89b2374b335c4a17"} Jun 10 15:13:52.954022 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.953441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" event={"ID":"4ad9c562-4e3b-44f1-85e2-3f0c6619b047","Type":"ContainerStarted","Data":"eba4532cd1d3d18ad5c33394215d6ffd8c24c487bb0ee672e83e056cd9dcecd2"} Jun 10 15:13:52.977096 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:52.977042 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" podStartSLOduration=1.9770217799999998 podStartE2EDuration="1.97702178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:13:52.975649732 +0000 UTC m=+734.193416350" watchObservedRunningTime="2026-06-10 15:13:52.97702178 +0000 UTC m=+734.194788383" Jun 10 15:13:53.897476 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:53.897440 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:53.902167 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:53.902141 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:53.957856 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:53.957825 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:53.958934 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:53.958914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:13:56.124284 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.124246 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:13:56.135873 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.135847 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.140354 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.140322 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 15:13:56.141660 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.141637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:13:56.157019 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.156991 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:13:56.253610 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.253542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g968\" (UniqueName: \"kubernetes.io/projected/c4529d0f-381e-479f-aba7-abc24b3388e5-kube-api-access-5g968\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.253781 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.253620 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4529d0f-381e-479f-aba7-abc24b3388e5-config-file\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.354291 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.354257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g968\" (UniqueName: \"kubernetes.io/projected/c4529d0f-381e-479f-aba7-abc24b3388e5-kube-api-access-5g968\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.354469 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.354410 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4529d0f-381e-479f-aba7-abc24b3388e5-config-file\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.355015 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.354995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4529d0f-381e-479f-aba7-abc24b3388e5-config-file\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.364009 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.363978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g968\" (UniqueName: \"kubernetes.io/projected/c4529d0f-381e-479f-aba7-abc24b3388e5-kube-api-access-5g968\") pod \"limitador-limitador-54d6d988d5-ghqqn\" (UID: \"c4529d0f-381e-479f-aba7-abc24b3388e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.447974 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.447888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:13:56.582449 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.582423 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:13:56.584314 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:13:56.584288 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4529d0f_381e_479f_aba7_abc24b3388e5.slice/crio-956b1f6ee1f9d0b17e7edab3b2649781c453fa46f27a76352faa4fa86e986299 WatchSource:0}: Error finding container 956b1f6ee1f9d0b17e7edab3b2649781c453fa46f27a76352faa4fa86e986299: Status 404 returned error can't find the container with id 956b1f6ee1f9d0b17e7edab3b2649781c453fa46f27a76352faa4fa86e986299 Jun 10 15:13:56.972627 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:56.972595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" event={"ID":"c4529d0f-381e-479f-aba7-abc24b3388e5","Type":"ContainerStarted","Data":"956b1f6ee1f9d0b17e7edab3b2649781c453fa46f27a76352faa4fa86e986299"} Jun 10 15:13:59.988197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:59.988152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" event={"ID":"c4529d0f-381e-479f-aba7-abc24b3388e5","Type":"ContainerStarted","Data":"1b5c1151f1addf0ebe50265255851899371c773a4fdc11159e5a9754c9aec237"} Jun 10 15:13:59.988605 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:13:59.988291 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:14:00.009497 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:14:00.009449 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" podStartSLOduration=1.639511044 podStartE2EDuration="4.009432553s" totalImagesPullingTime="2.369921509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:14:00.00830467 +0000 UTC m=+741.226071298" watchObservedRunningTime="2026-06-10 15:14:00.009432553 +0000 UTC m=+741.227199155" Jun 10 15:14:10.994549 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:14:10.994518 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ghqqn" Jun 10 15:16:07.644303 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.644270 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:16:07.687853 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.687817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcmbv"] Jun 10 15:16:07.690920 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.690901 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:07.693646 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.693619 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6sbv5\"" Jun 10 15:16:07.695859 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.695837 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 15:16:07.711501 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.711475 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcmbv"] Jun 10 15:16:07.736311 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.736278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75g65\" (UniqueName: \"kubernetes.io/projected/08242f91-8d9f-4575-8d5b-71756b10bb54-kube-api-access-75g65\") pod \"payload-processing-699b6cd6c-fcmbv\" (UID: \"08242f91-8d9f-4575-8d5b-71756b10bb54\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:07.837035 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.837003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75g65\" (UniqueName: \"kubernetes.io/projected/08242f91-8d9f-4575-8d5b-71756b10bb54-kube-api-access-75g65\") pod \"payload-processing-699b6cd6c-fcmbv\" (UID: \"08242f91-8d9f-4575-8d5b-71756b10bb54\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:07.850727 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:07.850704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75g65\" (UniqueName: \"kubernetes.io/projected/08242f91-8d9f-4575-8d5b-71756b10bb54-kube-api-access-75g65\") pod \"payload-processing-699b6cd6c-fcmbv\" (UID: \"08242f91-8d9f-4575-8d5b-71756b10bb54\") " pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:08.001115 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:08.001082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:08.167664 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:08.153646 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-fcmbv"] Jun 10 15:16:08.178760 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:16:08.178703 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08242f91_8d9f_4575_8d5b_71756b10bb54.slice/crio-c67a74ea7fdc2ddb8aea00ff342c6a52ed7dbbf2453b683934819c400156729b WatchSource:0}: Error finding container c67a74ea7fdc2ddb8aea00ff342c6a52ed7dbbf2453b683934819c400156729b: Status 404 returned error can't find the container with id c67a74ea7fdc2ddb8aea00ff342c6a52ed7dbbf2453b683934819c400156729b Jun 10 15:16:08.571083 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:08.571029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" event={"ID":"08242f91-8d9f-4575-8d5b-71756b10bb54","Type":"ContainerStarted","Data":"c67a74ea7fdc2ddb8aea00ff342c6a52ed7dbbf2453b683934819c400156729b"} Jun 10 15:16:11.593097 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:11.593062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" event={"ID":"08242f91-8d9f-4575-8d5b-71756b10bb54","Type":"ContainerStarted","Data":"03b058f6971d0fedbe9be9384e5db3e09d81d4eb5fb85f08dc32697410bcc571"} Jun 10 15:16:11.593578 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:11.593129 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:16:11.617419 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:11.617374 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" podStartSLOduration=2.086689037 podStartE2EDuration="4.617358707s" totalImagesPullingTime="2.53066967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:16:11.616371551 +0000 UTC m=+872.834138154" watchObservedRunningTime="2026-06-10 15:16:11.617358707 +0000 UTC m=+872.835125308" Jun 10 15:16:15.612888 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.612854 2573 generic.go:356] "Generic (PLEG): container finished" podID="4ad9c562-4e3b-44f1-85e2-3f0c6619b047" containerID="3eef88744203a61abbdf0f6e6f3d12e9a556399f91b5287d89b2374b335c4a17" exitCode=0 Jun 10 15:16:15.613299 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.612931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" event={"ID":"4ad9c562-4e3b-44f1-85e2-3f0c6619b047","Type":"ContainerDied","Data":"3eef88744203a61abbdf0f6e6f3d12e9a556399f91b5287d89b2374b335c4a17"} Jun 10 15:16:15.613369 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.613351 2573 scope.go:117] "RemoveContainer" containerID="3eef88744203a61abbdf0f6e6f3d12e9a556399f91b5287d89b2374b335c4a17" Jun 10 15:16:15.614456 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.614426 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:16:15.614532 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.614516 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:16:15.614643 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:15.614592 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 15:16:16.619578 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:16.619531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" event={"ID":"4ad9c562-4e3b-44f1-85e2-3f0c6619b047","Type":"ContainerStarted","Data":"4b6870f4a5bb589e1a1479181232a1a96163e7be707972e2842d94922a828729"} Jun 10 15:16:16.897514 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:16.897416 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:16:16.897687 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:16.897663 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-s658c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 15:16:16.897729 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:16.897711 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" podUID="4ad9c562-4e3b-44f1-85e2-3f0c6619b047" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 15:16:17.898004 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:17.897968 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-s658c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 15:16:17.898375 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:17.898021 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" podUID="4ad9c562-4e3b-44f1-85e2-3f0c6619b047" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 15:16:18.897707 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:18.897661 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-s658c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 15:16:18.897899 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:18.897724 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" podUID="4ad9c562-4e3b-44f1-85e2-3f0c6619b047" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 15:16:19.897732 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:19.897689 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-s658c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 15:16:19.898139 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:19.897761 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" podUID="4ad9c562-4e3b-44f1-85e2-3f0c6619b047" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 15:16:20.900986 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:20.900954 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:16:20.901447 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:20.901348 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:16:20.902599 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:20.902577 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-s658c" Jun 10 15:16:22.600268 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:16:22.600235 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-fcmbv" Jun 10 15:17:11.113013 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.112978 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq"] Jun 10 15:17:11.115496 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.115475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.125084 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.125065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 15:17:11.125177 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.125067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 15:17:11.125933 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.125918 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wvhhg\"" Jun 10 15:17:11.125982 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.125952 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 15:17:11.147705 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.147678 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq"] Jun 10 15:17:11.235624 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.235777 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.235777 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682651be-70b3-4368-95ef-51e8ac0be786-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.235777 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sz5d\" (UniqueName: \"kubernetes.io/projected/682651be-70b3-4368-95ef-51e8ac0be786-kube-api-access-2sz5d\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.235876 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.235876 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.235838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337016 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.336986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682651be-70b3-4368-95ef-51e8ac0be786-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337197 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sz5d\" (UniqueName: \"kubernetes.io/projected/682651be-70b3-4368-95ef-51e8ac0be786-kube-api-access-2sz5d\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337378 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337378 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337524 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337602 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337524 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.337664 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.337607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.339432 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.339408 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/682651be-70b3-4368-95ef-51e8ac0be786-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.339781 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.339759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/682651be-70b3-4368-95ef-51e8ac0be786-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.347835 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.347813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sz5d\" (UniqueName: \"kubernetes.io/projected/682651be-70b3-4368-95ef-51e8ac0be786-kube-api-access-2sz5d\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq\" (UID: \"682651be-70b3-4368-95ef-51e8ac0be786\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.425507 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.425410 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:17:11.595276 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.595250 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq"] Jun 10 15:17:11.598347 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:17:11.598315 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682651be_70b3_4368_95ef_51e8ac0be786.slice/crio-dff784b4b4cc7be90230844929337f3f21c10fd4fd2259e786408c3ac8b05ae5 WatchSource:0}: Error finding container dff784b4b4cc7be90230844929337f3f21c10fd4fd2259e786408c3ac8b05ae5: Status 404 returned error can't find the container with id dff784b4b4cc7be90230844929337f3f21c10fd4fd2259e786408c3ac8b05ae5 Jun 10 15:17:11.751081 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.751044 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:17:11.875322 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:11.875286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" event={"ID":"682651be-70b3-4368-95ef-51e8ac0be786","Type":"ContainerStarted","Data":"dff784b4b4cc7be90230844929337f3f21c10fd4fd2259e786408c3ac8b05ae5"} Jun 10 15:17:15.900861 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:15.900826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" event={"ID":"682651be-70b3-4368-95ef-51e8ac0be786","Type":"ContainerStarted","Data":"2183eec75d0f4645a039b0d90244879fa54e4763f26fc73c9c2eaf55310c919d"} Jun 10 15:17:28.267971 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:28.267933 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:17:46.594254 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.594208 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6"] Jun 10 15:17:46.598795 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.598770 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.601408 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.601380 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 15:17:46.620993 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.620966 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6"] Jun 10 15:17:46.773172 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.773172 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.773377 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.773377 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9d4\" (UniqueName: \"kubernetes.io/projected/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kube-api-access-mt9d4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.773377 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.773470 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.773418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0dded-13ac-4ef0-b866-95ce2bb01569-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874301 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874212 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874301 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9d4\" (UniqueName: \"kubernetes.io/projected/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kube-api-access-mt9d4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874301 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874596 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0dded-13ac-4ef0-b866-95ce2bb01569-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874596 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874596 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874745 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874745 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.874745 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.874725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.876639 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.876615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0dded-13ac-4ef0-b866-95ce2bb01569-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.876911 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.876895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0dded-13ac-4ef0-b866-95ce2bb01569-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.885008 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.884973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9d4\" (UniqueName: \"kubernetes.io/projected/6ba0dded-13ac-4ef0-b866-95ce2bb01569-kube-api-access-mt9d4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6\" (UID: \"6ba0dded-13ac-4ef0-b866-95ce2bb01569\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:46.909968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:46.909938 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:47.048047 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:47.048022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6"] Jun 10 15:17:47.051003 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:17:47.050978 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba0dded_13ac_4ef0_b866_95ce2bb01569.slice/crio-509cdd41a121e25c9866e8d6460514bbbc89f3ae6f9d0d52ee1ea65a08e48da6 WatchSource:0}: Error finding container 509cdd41a121e25c9866e8d6460514bbbc89f3ae6f9d0d52ee1ea65a08e48da6: Status 404 returned error can't find the container with id 509cdd41a121e25c9866e8d6460514bbbc89f3ae6f9d0d52ee1ea65a08e48da6 Jun 10 15:17:47.312424 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:47.312389 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:17:48.056968 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:48.056936 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" event={"ID":"6ba0dded-13ac-4ef0-b866-95ce2bb01569","Type":"ContainerStarted","Data":"7f429b58a88aa982992602c2b35dc1c2e9f108bc4bc64a78a32e638c15c55145"} Jun 10 15:17:48.057335 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:48.056987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" event={"ID":"6ba0dded-13ac-4ef0-b866-95ce2bb01569","Type":"ContainerStarted","Data":"509cdd41a121e25c9866e8d6460514bbbc89f3ae6f9d0d52ee1ea65a08e48da6"} Jun 10 15:17:49.063025 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:49.062991 2573 generic.go:356] "Generic (PLEG): container finished" podID="6ba0dded-13ac-4ef0-b866-95ce2bb01569" containerID="7f429b58a88aa982992602c2b35dc1c2e9f108bc4bc64a78a32e638c15c55145" exitCode=0 Jun 10 15:17:49.063425 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:49.063034 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" event={"ID":"6ba0dded-13ac-4ef0-b866-95ce2bb01569","Type":"ContainerDied","Data":"7f429b58a88aa982992602c2b35dc1c2e9f108bc4bc64a78a32e638c15c55145"} Jun 10 15:17:51.074048 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:51.074011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" event={"ID":"6ba0dded-13ac-4ef0-b866-95ce2bb01569","Type":"ContainerStarted","Data":"22a29804c9d962885824e51fc2b39c781494f7a4a542fdc6ee7ad850aa43b6a5"} Jun 10 15:17:51.096631 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:51.096546 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" podStartSLOduration=2.076613288 podStartE2EDuration="5.096525195s" totalImagesPullingTime="1.476774395s" totalInitContainerRuntime="1.543137512s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:17:51.096438845 +0000 UTC m=+972.314205531" watchObservedRunningTime="2026-06-10 15:17:51.096525195 +0000 UTC m=+972.314291798" Jun 10 15:17:56.910957 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:56.910907 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:56.911414 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:56.911006 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:56.923545 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:56.923513 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:57.112274 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:57.112242 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6" Jun 10 15:17:57.853252 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:57.853212 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:17:59.936530 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.936448 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx"] Jun 10 15:17:59.939701 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.939679 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.942345 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.942326 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 15:17:59.954061 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.954036 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx"] Jun 10 15:17:59.973392 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.973523 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.973523 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973469 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9sll\" (UniqueName: \"kubernetes.io/projected/8439ff40-b927-4b5c-9f39-a539db55d923-kube-api-access-s9sll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.973523 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.973713 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973612 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:17:59.973713 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:17:59.973654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ff40-b927-4b5c-9f39-a539db55d923-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074379 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074379 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ff40-b927-4b5c-9f39-a539db55d923-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074636 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074636 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074441 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074636 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9sll\" (UniqueName: \"kubernetes.io/projected/8439ff40-b927-4b5c-9f39-a539db55d923-kube-api-access-s9sll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074636 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074883 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074846 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.074939 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.074919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.075141 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.075120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.076966 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.076940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ff40-b927-4b5c-9f39-a539db55d923-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.077088 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.077045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8439ff40-b927-4b5c-9f39-a539db55d923-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.087552 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.087528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9sll\" (UniqueName: \"kubernetes.io/projected/8439ff40-b927-4b5c-9f39-a539db55d923-kube-api-access-s9sll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx\" (UID: \"8439ff40-b927-4b5c-9f39-a539db55d923\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.250357 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.250321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:18:00.389713 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.389687 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx"] Jun 10 15:18:00.392394 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:18:00.392367 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8439ff40_b927_4b5c_9f39_a539db55d923.slice/crio-2f9cd3bad5f8ba7b254ddf76be2dd5b51974593779edd73936daa22df338f484 WatchSource:0}: Error finding container 2f9cd3bad5f8ba7b254ddf76be2dd5b51974593779edd73936daa22df338f484: Status 404 returned error can't find the container with id 2f9cd3bad5f8ba7b254ddf76be2dd5b51974593779edd73936daa22df338f484 Jun 10 15:18:00.763405 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:00.763368 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:18:01.121068 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:01.120975 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" event={"ID":"8439ff40-b927-4b5c-9f39-a539db55d923","Type":"ContainerStarted","Data":"1b12609f6c303def832049cf4f58a0e9c2b4f3ee1201531cd95aa6adf7e39106"} Jun 10 15:18:01.121068 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:01.121027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" event={"ID":"8439ff40-b927-4b5c-9f39-a539db55d923","Type":"ContainerStarted","Data":"2f9cd3bad5f8ba7b254ddf76be2dd5b51974593779edd73936daa22df338f484"} Jun 10 15:18:10.165781 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:10.165749 2573 generic.go:356] "Generic (PLEG): container finished" podID="682651be-70b3-4368-95ef-51e8ac0be786" containerID="2183eec75d0f4645a039b0d90244879fa54e4763f26fc73c9c2eaf55310c919d" exitCode=0 Jun 10 15:18:10.166247 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:10.165824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" event={"ID":"682651be-70b3-4368-95ef-51e8ac0be786","Type":"ContainerDied","Data":"2183eec75d0f4645a039b0d90244879fa54e4763f26fc73c9c2eaf55310c919d"} Jun 10 15:18:10.166609 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:10.166590 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:18:11.172865 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:11.172829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" event={"ID":"682651be-70b3-4368-95ef-51e8ac0be786","Type":"ContainerStarted","Data":"c421e95f72f27abb0f117b35db4afe20c979f48429783239dc406064d1552583"} Jun 10 15:18:11.195337 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:11.195289 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" podStartSLOduration=2.083143312 podStartE2EDuration="1m0.195272767s" totalImagesPullingTime="4.54800915s" totalInitContainerRuntime="53.564120305s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:17:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:18:11.194751358 +0000 UTC m=+992.412517987" watchObservedRunningTime="2026-06-10 15:18:11.195272767 +0000 UTC m=+992.413039361" Jun 10 15:18:11.426438 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:11.426353 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:18:11.426595 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:11.426461 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:18:11.439123 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:11.439089 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:18:12.188473 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:12.188443 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq" Jun 10 15:18:13.850821 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:18:13.850784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ghqqn"] Jun 10 15:19:45.608533 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:45.608498 2573 generic.go:356] "Generic (PLEG): container finished" podID="8439ff40-b927-4b5c-9f39-a539db55d923" containerID="1b12609f6c303def832049cf4f58a0e9c2b4f3ee1201531cd95aa6adf7e39106" exitCode=0 Jun 10 15:19:45.608955 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:45.608584 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" event={"ID":"8439ff40-b927-4b5c-9f39-a539db55d923","Type":"ContainerDied","Data":"1b12609f6c303def832049cf4f58a0e9c2b4f3ee1201531cd95aa6adf7e39106"} Jun 10 15:19:46.615317 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:46.615278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" event={"ID":"8439ff40-b927-4b5c-9f39-a539db55d923","Type":"ContainerStarted","Data":"b7c6fca7b462d498416eb09bd7302c772a962f86e49c6d7e0096dadcc50d03d9"} Jun 10 15:19:46.640092 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:46.640039 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" podStartSLOduration=2.217187191 podStartE2EDuration="1m47.640021783s" totalImagesPullingTime="458.544568ms" totalInitContainerRuntime="1m44.964290024s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:19:46.637170275 +0000 UTC m=+1087.854936877" watchObservedRunningTime="2026-06-10 15:19:46.640021783 +0000 UTC m=+1087.857788384" Jun 10 15:19:50.250700 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:50.250661 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:19:50.251085 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:50.250727 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:19:50.263251 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:50.263224 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:19:50.644365 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:19:50.644277 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx" Jun 10 15:24:58.045414 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:24:58.045385 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6f5db44995-7nmbf_053fe3f7-989f-4b2c-adb8-77423afe76d2/nginx/0.log" Jun 10 15:24:59.145892 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:24:59.145862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58876c898f-x4w9j_ad3cf196-ec0d-4b3c-85f6-5399700bc5d3/copy-manifests/0.log" Jun 10 15:24:59.161317 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:24:59.161289 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58876c898f-x4w9j_ad3cf196-ec0d-4b3c-85f6-5399700bc5d3/manager/0.log" Jun 10 15:25:00.678713 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:00.678684 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-62xn5_09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c/manager/0.log" Jun 10 15:25:00.910132 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:00.910099 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r68ll_e88288fa-933f-4671-a6b8-b782f1f8010f/kuadrant-console-plugin/0.log" Jun 10 15:25:01.035470 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:01.035438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-td2pn_ce638b44-5e95-4fee-a29a-f9fe7bf8ff24/registry-server/0.log" Jun 10 15:25:01.278268 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:01.278240 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ghqqn_c4529d0f-381e-479f-aba7-abc24b3388e5/limitador/0.log" Jun 10 15:25:01.746185 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:01.746150 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcdzvrf_df7afbfe-d20e-4d22-80d2-722730901c9d/istio-proxy/0.log" Jun 10 15:25:02.219972 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:02.219892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/1.log" Jun 10 15:25:02.443389 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:02.443361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcmbv_08242f91-8d9f-4575-8d5b-71756b10bb54/payload-processing/0.log" Jun 10 15:25:02.915258 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:02.915225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq_682651be-70b3-4368-95ef-51e8ac0be786/storage-initializer/0.log" Jun 10 15:25:02.925729 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:02.925704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-llcsq_682651be-70b3-4368-95ef-51e8ac0be786/main/0.log" Jun 10 15:25:03.170577 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:03.170471 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6_6ba0dded-13ac-4ef0-b866-95ce2bb01569/storage-initializer/0.log" Jun 10 15:25:03.184068 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:03.184039 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-llnl6_6ba0dded-13ac-4ef0-b866-95ce2bb01569/main/0.log" Jun 10 15:25:03.452862 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:03.452787 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx_8439ff40-b927-4b5c-9f39-a539db55d923/storage-initializer/0.log" Jun 10 15:25:03.465969 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:03.465938 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mnxwx_8439ff40-b927-4b5c-9f39-a539db55d923/main/0.log" Jun 10 15:25:07.494041 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.493997 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mpsmf/must-gather-zs2b7"] Jun 10 15:25:07.496808 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.496790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.499352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.499325 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mpsmf\"/\"kube-root-ca.crt\"" Jun 10 15:25:07.499929 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.499906 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mpsmf\"/\"default-dockercfg-btzpr\"" Jun 10 15:25:07.507788 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.507764 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mpsmf\"/\"openshift-service-ca.crt\"" Jun 10 15:25:07.526479 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.526446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpsmf/must-gather-zs2b7"] Jun 10 15:25:07.638045 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.638007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f777e8a1-6151-4c17-a9c6-3b88864fd36b-must-gather-output\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.638257 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.638082 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2gj5\" (UniqueName: \"kubernetes.io/projected/f777e8a1-6151-4c17-a9c6-3b88864fd36b-kube-api-access-d2gj5\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.739084 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.739047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f777e8a1-6151-4c17-a9c6-3b88864fd36b-must-gather-output\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.739259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.739092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2gj5\" (UniqueName: \"kubernetes.io/projected/f777e8a1-6151-4c17-a9c6-3b88864fd36b-kube-api-access-d2gj5\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.739435 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.739410 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f777e8a1-6151-4c17-a9c6-3b88864fd36b-must-gather-output\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.754293 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.754226 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2gj5\" (UniqueName: \"kubernetes.io/projected/f777e8a1-6151-4c17-a9c6-3b88864fd36b-kube-api-access-d2gj5\") pod \"must-gather-zs2b7\" (UID: \"f777e8a1-6151-4c17-a9c6-3b88864fd36b\") " pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.807349 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.807304 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" Jun 10 15:25:07.950416 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.950377 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpsmf/must-gather-zs2b7"] Jun 10 15:25:07.954746 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:25:07.954715 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf777e8a1_6151_4c17_a9c6_3b88864fd36b.slice/crio-451aa27e8f54c71677afa428934e2237d3deb2b24f60c0770c104d2718c81e28 WatchSource:0}: Error finding container 451aa27e8f54c71677afa428934e2237d3deb2b24f60c0770c104d2718c81e28: Status 404 returned error can't find the container with id 451aa27e8f54c71677afa428934e2237d3deb2b24f60c0770c104d2718c81e28 Jun 10 15:25:07.956819 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:07.956799 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 15:25:08.132706 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:08.132627 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" event={"ID":"f777e8a1-6151-4c17-a9c6-3b88864fd36b","Type":"ContainerStarted","Data":"451aa27e8f54c71677afa428934e2237d3deb2b24f60c0770c104d2718c81e28"} Jun 10 15:25:10.157408 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:10.157353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" event={"ID":"f777e8a1-6151-4c17-a9c6-3b88864fd36b","Type":"ContainerStarted","Data":"20277990658dc0a3e35122a1241f16d8f0bfe5993497439ba1f7bafd0ced9ec6"} Jun 10 15:25:10.157914 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:10.157426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" event={"ID":"f777e8a1-6151-4c17-a9c6-3b88864fd36b","Type":"ContainerStarted","Data":"464c4b3c667655acb080b7c53cc5c5b244db6cab1019d2cee8fc1e415bb74e32"} Jun 10 15:25:10.184446 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:10.184383 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mpsmf/must-gather-zs2b7" podStartSLOduration=2.051236973 podStartE2EDuration="3.184364719s" totalImagesPullingTime="1.133127746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 15:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:25:10.182597054 +0000 UTC m=+1411.400363656" watchObservedRunningTime="2026-06-10 15:25:10.184364719 +0000 UTC m=+1411.402131323" Jun 10 15:25:11.055243 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:11.055210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zlkxx_3f5dc4e4-4cc7-465f-9ab4-204d385f6865/global-pull-secret-syncer/0.log" Jun 10 15:25:11.164441 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:11.164390 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l8n28_3ed76c00-1394-41dd-aed4-85f6abec6498/konnectivity-agent/0.log" Jun 10 15:25:11.277581 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:11.277515 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-243.ec2.internal_899d8cea7ff9ac33cfb934b9827471f2/haproxy/0.log" Jun 10 15:25:16.405326 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:16.405295 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-62xn5_09bd3fd2-1c95-44f3-9ae4-6c79d4a1a57c/manager/0.log" Jun 10 15:25:16.473190 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:16.473159 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r68ll_e88288fa-933f-4671-a6b8-b782f1f8010f/kuadrant-console-plugin/0.log" Jun 10 15:25:16.513250 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:16.513215 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-td2pn_ce638b44-5e95-4fee-a29a-f9fe7bf8ff24/registry-server/0.log" Jun 10 15:25:16.603807 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:16.603773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ghqqn_c4529d0f-381e-479f-aba7-abc24b3388e5/limitador/0.log" Jun 10 15:25:18.175054 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.175026 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/alertmanager/0.log" Jun 10 15:25:18.208974 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.208949 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/config-reloader/0.log" Jun 10 15:25:18.243085 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.243055 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy-web/0.log" Jun 10 15:25:18.274127 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.274091 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy/0.log" Jun 10 15:25:18.307775 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.307716 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/kube-rbac-proxy-metric/0.log" Jun 10 15:25:18.335778 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.335753 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/prom-label-proxy/0.log" Jun 10 15:25:18.369096 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.369051 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_08dc6d89-b397-4d56-a603-11f2304321c8/init-config-reloader/0.log" Jun 10 15:25:18.449981 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.449874 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-state-metrics/0.log" Jun 10 15:25:18.481409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.481360 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-rbac-proxy-main/0.log" Jun 10 15:25:18.511731 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.511699 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-gzjxf_d06dd82e-5cf3-4c41-831f-4cd0d0977a82/kube-rbac-proxy-self/0.log" Jun 10 15:25:18.567581 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.567403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5855c5655d-kzc4d_d0d819e7-455e-4b70-b329-2176173b448a/metrics-server/0.log" Jun 10 15:25:18.772531 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.772409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/node-exporter/0.log" Jun 10 15:25:18.805299 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.805243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/kube-rbac-proxy/0.log" Jun 10 15:25:18.835681 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:18.835490 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7lkx_7d18aec2-9264-469a-a09f-7fa2c2c5144c/init-textfile/0.log" Jun 10 15:25:19.446838 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:19.446796 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/telemeter-client/0.log" Jun 10 15:25:19.493482 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:19.491935 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/reload/0.log" Jun 10 15:25:19.530279 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:19.530247 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d84b8c8c6-4p6c6_6438458d-a6bf-4a25-ad62-4938120ba211/kube-rbac-proxy/0.log" Jun 10 15:25:21.566406 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.566370 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz"] Jun 10 15:25:21.574860 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.574834 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.588264 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.588229 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz"] Jun 10 15:25:21.606047 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.606009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-proc\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.606231 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.606085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-sys\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.606231 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.606116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhj2j\" (UniqueName: \"kubernetes.io/projected/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-kube-api-access-jhj2j\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.606231 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.606159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-lib-modules\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.606231 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.606199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-podres\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707234 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-proc\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-sys\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhj2j\" (UniqueName: \"kubernetes.io/projected/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-kube-api-access-jhj2j\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-lib-modules\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-podres\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-proc\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-sys\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707726 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-lib-modules\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.707726 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.707519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-podres\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.718917 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.718885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhj2j\" (UniqueName: \"kubernetes.io/projected/bcbbb28d-7628-4f5d-80f6-73a03cb4657b-kube-api-access-jhj2j\") pod \"perf-node-gather-daemonset-94pzz\" (UID: \"bcbbb28d-7628-4f5d-80f6-73a03cb4657b\") " pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:21.889694 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:21.889604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:22.061789 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:22.061756 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz"] Jun 10 15:25:22.063057 ip-10-0-141-243 kubenswrapper[2573]: W0610 15:25:22.063024 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbcbbb28d_7628_4f5d_80f6_73a03cb4657b.slice/crio-dd3da3799fb9c5cbde7cc28496b90ab8c6890861a4675a96c09d749f4b1c830f WatchSource:0}: Error finding container dd3da3799fb9c5cbde7cc28496b90ab8c6890861a4675a96c09d749f4b1c830f: Status 404 returned error can't find the container with id dd3da3799fb9c5cbde7cc28496b90ab8c6890861a4675a96c09d749f4b1c830f Jun 10 15:25:22.255551 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:22.255502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" event={"ID":"bcbbb28d-7628-4f5d-80f6-73a03cb4657b","Type":"ContainerStarted","Data":"d8bf9f9424f3590a0169a72eba2f02cc247a2e79f41583f6f25556fc97d70053"} Jun 10 15:25:22.255756 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:22.255601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" event={"ID":"bcbbb28d-7628-4f5d-80f6-73a03cb4657b","Type":"ContainerStarted","Data":"dd3da3799fb9c5cbde7cc28496b90ab8c6890861a4675a96c09d749f4b1c830f"} Jun 10 15:25:22.256352 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:22.256329 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:22.277105 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:22.277059 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" podStartSLOduration=1.277041641 podStartE2EDuration="1.277041641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 15:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 15:25:22.274622633 +0000 UTC m=+1423.492389236" watchObservedRunningTime="2026-06-10 15:25:22.277041641 +0000 UTC m=+1423.494808243" Jun 10 15:25:24.228751 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:24.228724 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7x775_cd3d4fe4-985c-4f33-89c4-3da4995912f9/dns/0.log" Jun 10 15:25:24.255528 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:24.255492 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7x775_cd3d4fe4-985c-4f33-89c4-3da4995912f9/kube-rbac-proxy/0.log" Jun 10 15:25:24.503467 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:24.503387 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k74jx_5d25317a-5b82-40ba-883c-6e9f08e46323/dns-node-resolver/0.log" Jun 10 15:25:25.164679 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:25.164646 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84f7f9bd99-ckftc_de9caf53-46d4-4878-96fe-ac8a762141b1/registry/0.log" Jun 10 15:25:25.244889 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:25.244863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vrg5n_7cac5aad-c80a-4d2e-b4aa-e881b8e5a380/node-ca/0.log" Jun 10 15:25:26.312584 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:26.312533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcdzvrf_df7afbfe-d20e-4d22-80d2-722730901c9d/istio-proxy/0.log" Jun 10 15:25:26.455705 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:26.455680 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/1.log" Jun 10 15:25:26.456259 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:26.456244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/0.log" Jun 10 15:25:26.524015 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:26.523985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcmbv_08242f91-8d9f-4575-8d5b-71756b10bb54/payload-processing/0.log" Jun 10 15:25:27.243579 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.243542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ffk9m_75aa764b-d74e-4bcf-af6f-4ba0cb19246b/serve-healthcheck-canary/0.log" Jun 10 15:25:27.890674 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.890644 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-krnfh_0ac2b1de-45f2-44eb-b221-1b3c660cd3fb/insights-operator/0.log" Jun 10 15:25:27.892589 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.892550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-krnfh_0ac2b1de-45f2-44eb-b221-1b3c660cd3fb/insights-operator/1.log" Jun 10 15:25:27.920935 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.920910 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fp6jt_8e8ebccb-a946-45a0-a460-d3cc0f434ed9/kube-rbac-proxy/0.log" Jun 10 15:25:27.952048 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.952024 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fp6jt_8e8ebccb-a946-45a0-a460-d3cc0f434ed9/exporter/0.log" Jun 10 15:25:27.984111 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:27.984082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fp6jt_8e8ebccb-a946-45a0-a460-d3cc0f434ed9/extractor/0.log" Jun 10 15:25:29.279797 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:29.279716 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mpsmf/perf-node-gather-daemonset-94pzz" Jun 10 15:25:30.834126 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:30.834104 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6f5db44995-7nmbf_053fe3f7-989f-4b2c-adb8-77423afe76d2/nginx/0.log" Jun 10 15:25:31.296028 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:31.295997 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58876c898f-x4w9j_ad3cf196-ec0d-4b3c-85f6-5399700bc5d3/manager/0.log" Jun 10 15:25:31.322844 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:31.322809 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58876c898f-x4w9j_ad3cf196-ec0d-4b3c-85f6-5399700bc5d3/copy-manifests/0.log" Jun 10 15:25:32.980409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:32.980379 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66bdc68598-v49rm_be579e82-abcc-49ff-8eea-fd5e055472eb/manager/0.log" Jun 10 15:25:33.052635 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:33.052608 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wbxvg_ee08aceb-186c-443c-81e2-8d938f9b843b/openshift-lws-operator/0.log" Jun 10 15:25:35.553111 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:35.553077 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcdzvrf_df7afbfe-d20e-4d22-80d2-722730901c9d/istio-proxy/0.log" Jun 10 15:25:35.775409 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:35.775371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/1.log" Jun 10 15:25:35.775788 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:35.775770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/0.log" Jun 10 15:25:35.814645 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:35.814577 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcmbv_08242f91-8d9f-4575-8d5b-71756b10bb54/payload-processing/0.log" Jun 10 15:25:36.950999 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:36.950972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcdzvrf_df7afbfe-d20e-4d22-80d2-722730901c9d/istio-proxy/0.log" Jun 10 15:25:37.051710 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:37.051683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/1.log" Jun 10 15:25:37.052904 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:37.052882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-s658c_4ad9c562-4e3b-44f1-85e2-3f0c6619b047/istio-proxy/0.log" Jun 10 15:25:37.089121 ip-10-0-141-243 kubenswrapper[2573]: I0610 15:25:37.089088 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-fcmbv_08242f91-8d9f-4575-8d5b-71756b10bb54/payload-processing/0.log"