Jun 09 02:21:40.710171 ip-10-0-138-26 systemd[1]: Starting Kubernetes Kubelet... Jun 09 02:21:41.144961 ip-10-0-138-26 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:21:41.144961 ip-10-0-138-26 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 02:21:41.144961 ip-10-0-138-26 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:21:41.144961 ip-10-0-138-26 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 02:21:41.144961 ip-10-0-138-26 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 02:21:41.145998 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.145923 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 02:21:41.152690 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152669 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.152690 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152688 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.152690 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152692 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.152690 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152696 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152699 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152702 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152705 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152709 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152713 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152717 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152721 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152724 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152727 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152730 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152732 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152735 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152738 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152741 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152744 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152746 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152749 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152751 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.152867 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152754 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152756 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152759 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152762 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152764 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152782 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152785 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152789 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152791 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152794 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152797 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152799 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152802 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152805 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152807 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152810 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152813 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152816 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152819 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152821 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.153327 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152824 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152827 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152829 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152832 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152834 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152837 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152839 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152842 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152845 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152847 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152850 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152852 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152860 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152862 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152866 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152868 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152871 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152874 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152877 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152880 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.153844 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152882 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152885 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152888 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152891 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152894 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152896 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152899 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152902 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152904 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152907 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152910 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152912 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152915 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152918 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152920 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152923 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152926 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152928 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152931 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152933 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.154361 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152936 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152939 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152941 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152944 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152947 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152949 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152952 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152954 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152957 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152959 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152962 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152964 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152967 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152971 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152975 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152978 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.152981 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153650 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153657 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153660 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.154868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153664 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153667 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153670 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153672 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153675 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153678 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153680 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153683 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153686 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153688 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153691 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153693 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153697 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153701 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153704 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153707 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153710 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153712 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153715 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.155355 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153717 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153720 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153723 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153725 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153728 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153730 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153733 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153737 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153739 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153742 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153744 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153747 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153750 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153754 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153757 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153759 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153762 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153764 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153784 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153789 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.155843 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153793 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153797 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153801 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153804 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153807 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153809 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153812 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153814 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153818 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153821 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153824 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153826 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153829 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153831 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153834 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153836 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153839 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153841 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153844 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153846 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.156336 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153849 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153852 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153857 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153860 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153864 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153867 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153872 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153876 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153879 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153882 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153885 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153888 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153890 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153893 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153895 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153898 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153900 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153903 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153905 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.156849 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153908 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153911 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153914 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153916 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153919 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153922 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153924 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153927 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153930 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153932 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153935 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153938 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153941 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153943 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153946 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153948 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153951 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.153953 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154318 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154322 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.157313 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154325 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154328 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154331 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154334 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154337 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154339 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154342 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154344 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154347 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154352 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154354 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154357 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154360 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154363 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154366 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154369 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154372 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154375 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154377 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.157895 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154380 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154383 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154386 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154389 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154393 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154396 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154398 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154401 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154404 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154406 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154409 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154412 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154414 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154417 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154419 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154422 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154424 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154427 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154429 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154432 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.158380 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154434 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154437 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154439 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154442 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154444 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154447 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154449 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154452 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154455 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154457 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154460 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154462 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154465 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154467 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154471 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154474 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154478 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154482 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154485 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154488 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.158874 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154491 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154493 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154496 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154499 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154502 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154504 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154507 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154510 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154512 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154515 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154518 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154521 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154524 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154526 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154531 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154538 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154540 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154543 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154545 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154549 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.159404 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154552 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154555 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154558 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154560 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154563 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154566 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154568 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154571 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154575 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154578 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154581 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154583 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154586 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154589 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154591 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154594 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.154596 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154678 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154687 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154696 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154702 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 02:21:41.159911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154707 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154713 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154718 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154723 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154726 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154731 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154736 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154739 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154742 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154745 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154748 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154751 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154755 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154757 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154761 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154764 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154780 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154783 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154786 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154790 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154793 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154796 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154799 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154802 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 02:21:41.160419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154805 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154808 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154811 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154814 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154818 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154821 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154824 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154826 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154829 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154832 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154836 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154839 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154842 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154847 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154851 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154854 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154857 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154860 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154863 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154866 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154869 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154872 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154876 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154879 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154881 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 02:21:41.161002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154884 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154888 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154891 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154894 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154897 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154899 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154902 2577 flags.go:64] FLAG: --help="false" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154905 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154908 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154911 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154914 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154917 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154920 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154923 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154926 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154929 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154932 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154934 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154937 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154940 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154944 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154948 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154951 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154954 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 02:21:41.161624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154957 2577 flags.go:64] FLAG: --lock-file="" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154960 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154963 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154966 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154971 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154974 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154976 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154979 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154982 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154985 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154988 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154991 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154995 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.154998 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155001 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155004 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155007 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155010 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155012 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155015 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155018 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155021 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155041 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155046 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155049 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 02:21:41.162255 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155053 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155056 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155061 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155064 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155069 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155072 2577 flags.go:64] FLAG: --port="10250" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155075 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155078 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063ef2d4bd74bf14d" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155081 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155084 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155087 2577 flags.go:64] FLAG: --register-node="true" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155090 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155093 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155096 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155099 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155102 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155106 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155109 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155112 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155115 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155117 2577 flags.go:64] FLAG: --runonce="false" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155120 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155123 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155126 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155129 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 02:21:41.162890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155132 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155135 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155138 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155141 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155144 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155146 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155149 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155152 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155155 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155158 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155160 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155168 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155171 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155181 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155185 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155188 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155191 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155194 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155197 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155200 2577 flags.go:64] FLAG: --v="2" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155204 2577 flags.go:64] FLAG: --version="false" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155208 2577 flags.go:64] FLAG: --vmodule="" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155212 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.155215 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155323 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.163521 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155327 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155330 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155333 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155336 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155339 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155341 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155344 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155346 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155349 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155352 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155354 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155357 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155360 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155363 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155365 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155368 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155371 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155373 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155379 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.164145 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155382 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155384 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155387 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155389 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155392 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155395 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155397 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155400 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155402 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155405 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155409 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155412 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155414 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155417 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155419 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155423 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155427 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155429 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155432 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155435 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.164617 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155437 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155440 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155442 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155445 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155447 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155450 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155452 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155455 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155457 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155460 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155462 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155467 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155469 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155472 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155474 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155477 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155479 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155482 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155485 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.165139 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155488 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155490 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155492 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155495 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155498 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155501 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155503 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155506 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155509 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155525 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155529 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155532 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155536 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155539 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155542 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155545 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155548 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155551 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155554 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.165605 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155557 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155559 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155562 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155565 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155568 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155573 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155576 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155579 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155582 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155585 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155588 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155591 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155594 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155597 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155601 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155604 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155607 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155610 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155613 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155615 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.166121 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.155618 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.156784 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.162842 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.162857 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.163888 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.163896 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163951 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163956 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163959 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163962 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163965 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163968 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163971 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163974 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163976 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.166610 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163979 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163982 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163984 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163987 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163990 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163992 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163996 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.163998 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164001 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164004 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164006 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164009 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164011 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164014 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164017 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164020 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164022 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164025 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164028 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.166996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164030 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164034 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164037 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164040 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164043 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164045 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164048 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164051 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164055 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164058 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164061 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164064 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164067 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164069 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164072 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164075 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164077 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164080 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164083 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164085 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.167502 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164088 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164090 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164093 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164095 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164098 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164101 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164103 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164106 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164110 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164114 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164117 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164120 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164122 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164125 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164129 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164132 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164136 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164139 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164142 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164144 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.168001 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164147 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164150 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164152 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164155 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164158 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164160 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164163 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164165 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164168 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164171 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164174 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164176 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164179 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164182 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164184 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164187 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164189 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164192 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164194 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164197 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.168487 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164200 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164202 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164205 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164208 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164211 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164213 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164216 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164218 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164221 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164224 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164226 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.164231 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164338 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164343 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164346 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 02:21:41.169018 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164348 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164351 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164354 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164357 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164360 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164363 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164365 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164368 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164370 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164374 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164376 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164379 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164381 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164384 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164386 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164389 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164391 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164394 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164397 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164399 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 02:21:41.169377 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164402 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164405 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164408 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164410 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164413 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164415 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164418 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164420 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164423 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164425 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164427 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164430 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164432 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164435 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164437 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164440 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164442 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164445 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164447 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164450 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 02:21:41.169883 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164453 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164457 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164460 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164463 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164466 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164469 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164472 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164475 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164477 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164480 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164482 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164485 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164488 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164491 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164494 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164497 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164499 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164502 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164504 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 02:21:41.170373 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164507 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164510 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164513 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164516 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164519 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164522 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164524 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164527 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164530 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164533 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164535 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164539 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164541 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164544 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164547 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164549 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164552 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164554 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164557 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 02:21:41.170920 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164559 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164562 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164564 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164567 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164569 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164572 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164574 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164577 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164580 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164583 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164585 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164588 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164590 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164593 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164595 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164598 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164601 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 02:21:41.171376 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:41.164603 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.164608 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.164699 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.166873 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.168156 2577 server.go:1019] "Starting client certificate rotation" Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.168261 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.168295 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 02:21:41.171798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.170809 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:21:41.172012 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.171996 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 02:21:41.183001 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.182722 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 02:21:41.185528 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.185514 2577 log.go:25] "Validated CRI v1 image API" Jun 09 02:21:41.186332 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.186315 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 02:21:41.191312 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.191291 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c11dbc6a-76f1-443b-9b4f-83cc1c55e3e8:/dev/nvme0n1p3 c1ed30fe-3eed-4cb6-b851-8707ad3d60b6:/dev/nvme0n1p4] Jun 09 02:21:41.191376 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.191310 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 02:21:41.197196 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.197096 2577 manager.go:216] Machine: {Timestamp:2026-06-09 02:21:41.19569736 +0000 UTC m=+0.358067595 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099883 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cc0b035c11305cb9f9caf7f5c76de SystemUUID:ec2cc0b0-35c1-1305-cb9f-9caf7f5c76de BootID:14722840-7c02-4087-a5b4-50ea40a3c46d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:bf:e3:9a:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:bf:e3:9a:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:aa:1b:2c:41:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 02:21:41.197196 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.197188 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 02:21:41.197388 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.197251 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 02:21:41.200748 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.200723 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 02:21:41.200880 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.200750 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 02:21:41.201898 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.201888 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 02:21:41.201939 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.201899 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 02:21:41.201939 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.201906 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:21:41.202631 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.202620 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 02:21:41.202712 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.202695 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:21:41.203407 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.203397 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 02:21:41.206624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206611 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:21:41.206725 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206716 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 02:21:41.206785 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206743 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 02:21:41.206785 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206760 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 02:21:41.206862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206815 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 02:21:41.206862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206826 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 02:21:41.206862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.206835 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 02:21:41.207146 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.207134 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:21:41.207195 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.207160 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 02:21:41.209451 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.209435 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 02:21:41.211165 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.211151 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 02:21:41.211230 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.211187 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 02:21:41.212592 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212580 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212597 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212604 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212609 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212617 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212622 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212630 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 02:21:41.212635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212635 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 02:21:41.212862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212641 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 02:21:41.212862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212646 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 02:21:41.212862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212658 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 02:21:41.212862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.212663 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 02:21:41.213344 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.213334 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 02:21:41.213344 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.213344 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 02:21:41.216352 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.216337 2577 server.go:1268] "Started kubelet" Jun 09 02:21:41.216465 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.216416 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 02:21:41.216533 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.216514 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 02:21:41.220515 ip-10-0-138-26 systemd[1]: Started Kubernetes Kubelet. Jun 09 02:21:41.220945 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.220283 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 02:21:41.220945 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.220811 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 02:21:41.221056 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.221031 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 02:21:41.221259 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.221172 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 02:21:41.222374 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.222331 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 02:21:41.224395 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.224379 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 02:21:41.225668 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.225651 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 02:21:41.226373 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.225364 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-26.ec2.internal.18b7485386057121 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-26.ec2.internal,UID:ip-10-0-138-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-26.ec2.internal,},FirstTimestamp:2026-06-09 02:21:41.216309537 +0000 UTC m=+0.378679771,LastTimestamp:2026-06-09 02:21:41.216309537 +0000 UTC m=+0.378679771,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-26.ec2.internal,}" Jun 09 02:21:41.228440 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.228418 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 02:21:41.228440 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.228433 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 02:21:41.228685 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.228667 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.229147 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229127 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 02:21:41.229238 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229127 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 02:21:41.229238 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229166 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 02:21:41.229238 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229176 2577 factory.go:55] Registering systemd factory Jun 09 02:21:41.229238 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229192 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 02:21:41.229421 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229240 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 02:21:41.229421 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229249 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 02:21:41.229518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229435 2577 factory.go:153] Registering CRI-O factory Jun 09 02:21:41.229518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229450 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 02:21:41.229518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229496 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 02:21:41.229518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229517 2577 factory.go:103] Registering Raw factory Jun 09 02:21:41.229668 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.229532 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 02:21:41.230165 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.230083 2577 manager.go:349] Starting recovery of all containers Jun 09 02:21:41.238097 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.237990 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 02:21:41.238097 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.238050 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 02:21:41.239456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.239440 2577 manager.go:354] Recovery completed Jun 09 02:21:41.240655 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.240631 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 02:21:41.241828 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.241810 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlxr5" Jun 09 02:21:41.243421 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.243410 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.245039 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245026 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.245126 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245053 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.245126 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245067 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.245527 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245513 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 02:21:41.245527 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245526 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 02:21:41.245586 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245540 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 02:21:41.245620 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.245583 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.246248 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246229 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.246290 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246255 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.246290 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246268 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.246844 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246810 2577 policy_none.go:49] "None policy: Start" Jun 09 02:21:41.246844 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246850 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 02:21:41.246994 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.246868 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 02:21:41.247066 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.246978 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-26.ec2.internal.18b7485387bbd00d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-26.ec2.internal,UID:ip-10-0-138-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-26.ec2.internal,},FirstTimestamp:2026-06-09 02:21:41.245038605 +0000 UTC m=+0.407408844,LastTimestamp:2026-06-09 02:21:41.245038605 +0000 UTC m=+0.407408844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-26.ec2.internal,}" Jun 09 02:21:41.248618 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.248595 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlxr5" Jun 09 02:21:41.249261 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.249246 2577 policy_none.go:47] "Start" Jun 09 02:21:41.293300 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293285 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.293317 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293328 2577 server.go:87] "Starting device plugin registration server" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293516 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293529 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293614 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293715 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.293723 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.294268 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.294327 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.301119 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.302257 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.302288 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.302304 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.302336 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 02:21:41.308181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.304489 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:21:41.393653 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.393624 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.394425 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.394400 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.394425 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.394426 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.394540 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.394437 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.394540 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.394456 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.402105 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.402060 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.402105 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.402084 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-26.ec2.internal\": node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.403244 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.403227 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal"] Jun 09 02:21:41.403293 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.403282 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.404903 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.404888 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.405002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.404912 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.405002 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.404925 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.407337 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.407321 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.407480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.407464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.407558 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.407493 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.408013 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.407999 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.408013 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.408008 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.408141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.408022 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.408141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.408030 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.408141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.408046 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.408141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.408032 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.410343 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.410320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.410343 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.410346 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 02:21:41.416875 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.416857 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientMemory" Jun 09 02:21:41.416962 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.416884 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 02:21:41.416962 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.416895 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeHasSufficientPID" Jun 09 02:21:41.422985 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.422968 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.425284 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.425269 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-26.ec2.internal\" not found" node="ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.429693 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.429674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b58dbed080db581ba525e909595b658-config\") pod \"kube-apiserver-proxy-ip-10-0-138-26.ec2.internal\" (UID: \"7b58dbed080db581ba525e909595b658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.429792 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.429709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.429792 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.429736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.431017 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.431002 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-26.ec2.internal\" not found" node="ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.523505 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.523485 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.530775 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b58dbed080db581ba525e909595b658-config\") pod \"kube-apiserver-proxy-ip-10-0-138-26.ec2.internal\" (UID: \"7b58dbed080db581ba525e909595b658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.530821 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.530821 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.530885 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.530885 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02feba71ffe676d909d3fccf76b03db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal\" (UID: \"02feba71ffe676d909d3fccf76b03db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.530885 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.530853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7b58dbed080db581ba525e909595b658-config\") pod \"kube-apiserver-proxy-ip-10-0-138-26.ec2.internal\" (UID: \"7b58dbed080db581ba525e909595b658\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.623964 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.623912 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.724711 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.724650 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.732073 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.732059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.737623 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:41.737604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:41.825314 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.825288 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:41.925815 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:41.925791 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.026397 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.026343 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.126837 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.126815 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.167355 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.167334 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 02:21:42.167851 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.167469 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 02:21:42.227973 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.227952 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.250857 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.250820 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 02:16:41 +0000 UTC" deadline="2027-11-19 20:46:34.529688039 +0000 UTC" Jun 09 02:21:42.250857 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.250856 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12690h24m52.278837275s" Jun 09 02:21:42.306500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.306460 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:21:42.328445 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.328426 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.343449 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:42.343419 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02feba71ffe676d909d3fccf76b03db3.slice/crio-4e28f51526d7637b1bfe9e23fe70cdc1a662a69cb5302023a7476dd49f450254 WatchSource:0}: Error finding container 4e28f51526d7637b1bfe9e23fe70cdc1a662a69cb5302023a7476dd49f450254: Status 404 returned error can't find the container with id 4e28f51526d7637b1bfe9e23fe70cdc1a662a69cb5302023a7476dd49f450254 Jun 09 02:21:42.343978 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:42.343957 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b58dbed080db581ba525e909595b658.slice/crio-e52c94694a51c69856f4893b7d54c99efce8543dea9db1755c60c4bf34aba424 WatchSource:0}: Error finding container e52c94694a51c69856f4893b7d54c99efce8543dea9db1755c60c4bf34aba424: Status 404 returned error can't find the container with id e52c94694a51c69856f4893b7d54c99efce8543dea9db1755c60c4bf34aba424 Jun 09 02:21:42.347590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.347576 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:21:42.429352 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.429317 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.529685 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.529665 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.600861 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.600812 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:21:42.629873 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:42.629856 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-26.ec2.internal\" not found" Jun 09 02:21:42.668364 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.668345 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:21:42.729412 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.729384 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" Jun 09 02:21:42.738929 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.738911 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:21:42.740104 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.740091 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" Jun 09 02:21:42.750642 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:42.750626 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 02:21:43.208589 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.208314 2577 apiserver.go:52] "Watching apiserver" Jun 09 02:21:43.215996 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.215967 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 02:21:43.216465 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.216420 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-7hkbk","openshift-multus/multus-xmtlr","kube-system/konnectivity-agent-9vvwc","openshift-image-registry/node-ca-ktspj","openshift-multus/network-metrics-daemon-qvf66","openshift-network-diagnostics/network-check-target-ff6vw","openshift-network-operator/iptables-alerter-n7k7f","openshift-ovn-kubernetes/ovnkube-node-cxm7c","kube-system/global-pull-secret-syncer-6sv5q","kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj","openshift-cluster-node-tuning-operator/tuned-wjdjg","openshift-dns/node-resolver-fmvnh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal"] Jun 09 02:21:43.219246 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.219223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.221294 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.221110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.222447 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.222428 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.222680 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.222660 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 02:21:43.222870 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.222855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.223129 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.223112 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bz6g9\"" Jun 09 02:21:43.225487 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.225467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.225575 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.225535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.225807 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.225792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b4srz\"" Jun 09 02:21:43.226000 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.225986 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.226181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.226168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.228045 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.227465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 02:21:43.228045 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.227993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 02:21:43.228199 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228167 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 02:21:43.228303 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.228440 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9knk\"" Jun 09 02:21:43.228572 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228552 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.228651 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.228705 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.228684 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:43.228986 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.228967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wh54x\"" Jun 09 02:21:43.229145 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.229131 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 02:21:43.230485 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.230463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:43.230576 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.230532 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:43.233910 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.233817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.233910 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.233880 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:43.236067 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.236047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.238166 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2622c48b-c487-46c7-9a61-87dba1e9b2e8-host-slash\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.238257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzxjl\" (UniqueName: \"kubernetes.io/projected/53c8ff5a-405e-44f9-88a1-64b78ff78b25-kube-api-access-mzxjl\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.238257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7t9n\" (UniqueName: \"kubernetes.io/projected/2622c48b-c487-46c7-9a61-87dba1e9b2e8-kube-api-access-l7t9n\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.238257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f354c442-b9c3-49db-b1ee-c72040a0f38c-hosts-file\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.238257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78fdq\" (UniqueName: \"kubernetes.io/projected/f354c442-b9c3-49db-b1ee-c72040a0f38c-kube-api-access-78fdq\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-konnectivity-ca\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-host\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgln2\" (UniqueName: \"kubernetes.io/projected/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-kube-api-access-fgln2\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2622c48b-c487-46c7-9a61-87dba1e9b2e8-iptables-alerter-script\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f354c442-b9c3-49db-b1ee-c72040a0f38c-tmp-dir\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-agent-certs\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.238456 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-serviceca\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.238843 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:43.238843 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.238753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.239232 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239213 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 02:21:43.239311 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239255 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fxvwg\"" Jun 09 02:21:43.239372 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239354 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.239468 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239451 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 02:21:43.239576 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239559 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.239576 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239567 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 02:21:43.239679 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.239452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 02:21:43.241207 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.241181 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 02:21:43.241441 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.241421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xb2zs\"" Jun 09 02:21:43.241857 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.241679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.243926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.243929 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.244385 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.244489 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.244554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 02:21:43.244781 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.244634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbpcx\"" Jun 09 02:21:43.245474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.245457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.245802 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.245761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 02:21:43.248616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.247401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gxzdl\"" Jun 09 02:21:43.248616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.247687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.248616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.247929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.248616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.248068 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 02:21:43.248616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.248555 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.251361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.251342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:21:43.251844 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.251667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64tjx\"" Jun 09 02:21:43.253236 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.252877 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 02:21:43.258114 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.257954 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zj645" Jun 09 02:21:43.265597 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.265570 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zj645" Jun 09 02:21:43.307011 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.306968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" event={"ID":"7b58dbed080db581ba525e909595b658","Type":"ContainerStarted","Data":"e52c94694a51c69856f4893b7d54c99efce8543dea9db1755c60c4bf34aba424"} Jun 09 02:21:43.308163 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.308138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" event={"ID":"02feba71ffe676d909d3fccf76b03db3","Type":"ContainerStarted","Data":"4e28f51526d7637b1bfe9e23fe70cdc1a662a69cb5302023a7476dd49f450254"} Jun 09 02:21:43.330684 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.330661 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 02:21:43.339372 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-device-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.339474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-ovn\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.339474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2622c48b-c487-46c7-9a61-87dba1e9b2e8-host-slash\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.339474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.339474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.339474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-socket-dir-parent\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-systemd\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2622c48b-c487-46c7-9a61-87dba1e9b2e8-host-slash\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-lib-modules\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-system-cni-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-os-release\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-bin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-agent-certs\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.339787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-host\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-multus\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-daemon-config\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-socket-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.339967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-multus-certs\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-systemd-units\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.340177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340077 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-modprobe-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjsg5\" (UniqueName: \"kubernetes.io/projected/f0d99c45-3518-42bc-82ab-266824513125-kube-api-access-tjsg5\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-cnibin\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-netns\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-kubelet\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qm8n\" (UniqueName: \"kubernetes.io/projected/f068f487-04d2-41d8-945a-1a75dbe44b63-kube-api-access-8qm8n\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-bin\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-kubernetes\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.340581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-var-lib-kubelet\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-env-overrides\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-serviceca\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzt78\" (UniqueName: \"kubernetes.io/projected/ad862208-0b48-4ca7-8e96-a191b51a273c-kube-api-access-bzt78\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-conf\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-tmp\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzxjl\" (UniqueName: \"kubernetes.io/projected/53c8ff5a-405e-44f9-88a1-64b78ff78b25-kube-api-access-mzxjl\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-conf-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.341014 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.340995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8jh\" (UniqueName: \"kubernetes.io/projected/9ee95329-5de6-43a8-9586-c8c9e58ad502-kube-api-access-bf8jh\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f354c442-b9c3-49db-b1ee-c72040a0f38c-hosts-file\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78fdq\" (UniqueName: \"kubernetes.io/projected/f354c442-b9c3-49db-b1ee-c72040a0f38c-kube-api-access-78fdq\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-serviceca\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-konnectivity-ca\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341156 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f354c442-b9c3-49db-b1ee-c72040a0f38c-hosts-file\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgln2\" (UniqueName: \"kubernetes.io/projected/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-kube-api-access-fgln2\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-kubelet-config\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-os-release\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-cnibin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2622c48b-c487-46c7-9a61-87dba1e9b2e8-iptables-alerter-script\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qkf\" (UniqueName: \"kubernetes.io/projected/2a5e0604-b335-411c-9874-c92dc2be2ef1-kube-api-access-z5qkf\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.341398 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-var-lib-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.341552 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.341470 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:43.841439338 +0000 UTC m=+3.003809574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-etc-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-netd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-config\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad862208-0b48-4ca7-8e96-a191b51a273c-ovn-node-metrics-cert\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysconfig\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-node-log\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-script-lib\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-run\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-k8s-cni-cncf-io\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-etc-kubernetes\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-log-socket\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7t9n\" (UniqueName: \"kubernetes.io/projected/2622c48b-c487-46c7-9a61-87dba1e9b2e8-kube-api-access-l7t9n\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-host\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-system-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2622c48b-c487-46c7-9a61-87dba1e9b2e8-iptables-alerter-script\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.342339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.341976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-konnectivity-ca\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-host\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-sys-fs\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-slash\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-sys\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f354c442-b9c3-49db-b1ee-c72040a0f38c-tmp-dir\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-cni-binary-copy\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-registration-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-kubelet\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-netns\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-systemd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-etc-tuned\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-dbus\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-hostroot\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.343016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.342587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f354c442-b9c3-49db-b1ee-c72040a0f38c-tmp-dir\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.346947 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.346925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d5b1d7f-8fe9-40ae-a6d1-fc151817e377-agent-certs\") pod \"konnectivity-agent-9vvwc\" (UID: \"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377\") " pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.347202 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.347177 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:43.347299 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.347204 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:43.347299 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.347218 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:43.347299 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.347270 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:43.847255809 +0000 UTC m=+3.009626033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:43.350312 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.350279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzxjl\" (UniqueName: \"kubernetes.io/projected/53c8ff5a-405e-44f9-88a1-64b78ff78b25-kube-api-access-mzxjl\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.350591 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.350568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7t9n\" (UniqueName: \"kubernetes.io/projected/2622c48b-c487-46c7-9a61-87dba1e9b2e8-kube-api-access-l7t9n\") pod \"iptables-alerter-n7k7f\" (UID: \"2622c48b-c487-46c7-9a61-87dba1e9b2e8\") " pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.350932 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.350907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgln2\" (UniqueName: \"kubernetes.io/projected/ef30b5e5-ab28-4ed4-98de-e3bf134130d1-kube-api-access-fgln2\") pod \"node-ca-ktspj\" (UID: \"ef30b5e5-ab28-4ed4-98de-e3bf134130d1\") " pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.351592 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.351567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78fdq\" (UniqueName: \"kubernetes.io/projected/f354c442-b9c3-49db-b1ee-c72040a0f38c-kube-api-access-78fdq\") pod \"node-resolver-fmvnh\" (UID: \"f354c442-b9c3-49db-b1ee-c72040a0f38c\") " pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.443232 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-etc-tuned\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.443232 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-dbus\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.443232 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-hostroot\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-device-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-ovn\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-hostroot\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-socket-dir-parent\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-ovn\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-device-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-dbus\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443393 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-socket-dir-parent\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-systemd\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-lib-modules\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-systemd\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.443460 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:43.443496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-system-cni-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-system-cni-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.443519 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:43.943504181 +0000 UTC m=+3.105874403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-lib-modules\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-os-release\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-bin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-host\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-os-release\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-multus\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-bin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-daemon-config\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-socket-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-cni-multus\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.444361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-host\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-multus-certs\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-systemd-units\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-socket-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-modprobe-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjsg5\" (UniqueName: \"kubernetes.io/projected/f0d99c45-3518-42bc-82ab-266824513125-kube-api-access-tjsg5\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-multus-certs\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-cnibin\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-netns\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-systemd-units\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-kubelet\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qm8n\" (UniqueName: \"kubernetes.io/projected/f068f487-04d2-41d8-945a-1a75dbe44b63-kube-api-access-8qm8n\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-cnibin\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.443942 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-modprobe-d\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444162 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-netns\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-var-lib-kubelet\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-bin\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-kubernetes\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-var-lib-kubelet\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-env-overrides\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-bin\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-daemon-config\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzt78\" (UniqueName: \"kubernetes.io/projected/ad862208-0b48-4ca7-8e96-a191b51a273c-kube-api-access-bzt78\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-var-lib-kubelet\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-kubernetes\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-conf\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-tmp\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-conf-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.445793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8jh\" (UniqueName: \"kubernetes.io/projected/9ee95329-5de6-43a8-9586-c8c9e58ad502-kube-api-access-bf8jh\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-multus-conf-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-kubelet-config\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysctl-conf\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-os-release\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-cnibin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a5e0604-b335-411c-9874-c92dc2be2ef1-os-release\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qkf\" (UniqueName: \"kubernetes.io/projected/2a5e0604-b335-411c-9874-c92dc2be2ef1-kube-api-access-z5qkf\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-env-overrides\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-cnibin\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-var-lib-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-var-lib-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-etc-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da81d0b-243e-478c-8f74-064a6c8a56b4-kubelet-config\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-netd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-config\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-etc-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444871 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-cni-netd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad862208-0b48-4ca7-8e96-a191b51a273c-ovn-node-metrics-cert\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysconfig\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-node-log\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-script-lib\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.444987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-run\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-k8s-cni-cncf-io\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-etc-kubernetes\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-etc-sysconfig\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-log-socket\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-system-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.446884 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-sys-fs\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-slash\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-sys\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-cni-binary-copy\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-registration-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-kubelet\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-netns\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-systemd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-run\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-slash\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-openvswitch\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-host-run-k8s-cni-cncf-io\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d99c45-3518-42bc-82ab-266824513125-sys\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-node-log\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-etc-kubernetes\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-log-socket\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f068f487-04d2-41d8-945a-1a75dbe44b63-system-cni-dir\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.447345 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-script-lib\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-sys-fs\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-run-netns\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-host-kubelet\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad862208-0b48-4ca7-8e96-a191b51a273c-run-systemd\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad862208-0b48-4ca7-8e96-a191b51a273c-ovnkube-config\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ee95329-5de6-43a8-9586-c8c9e58ad502-registration-dir\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.445958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f068f487-04d2-41d8-945a-1a75dbe44b63-cni-binary-copy\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.446100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a5e0604-b335-411c-9874-c92dc2be2ef1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.446176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-etc-tuned\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.447938 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.446478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0d99c45-3518-42bc-82ab-266824513125-tmp\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.448353 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.448166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad862208-0b48-4ca7-8e96-a191b51a273c-ovn-node-metrics-cert\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.453743 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.453718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qm8n\" (UniqueName: \"kubernetes.io/projected/f068f487-04d2-41d8-945a-1a75dbe44b63-kube-api-access-8qm8n\") pod \"multus-xmtlr\" (UID: \"f068f487-04d2-41d8-945a-1a75dbe44b63\") " pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.454398 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.454367 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzt78\" (UniqueName: \"kubernetes.io/projected/ad862208-0b48-4ca7-8e96-a191b51a273c-kube-api-access-bzt78\") pod \"ovnkube-node-cxm7c\" (UID: \"ad862208-0b48-4ca7-8e96-a191b51a273c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.454729 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.454705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qkf\" (UniqueName: \"kubernetes.io/projected/2a5e0604-b335-411c-9874-c92dc2be2ef1-kube-api-access-z5qkf\") pod \"multus-additional-cni-plugins-7hkbk\" (UID: \"2a5e0604-b335-411c-9874-c92dc2be2ef1\") " pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.454993 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.454976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8jh\" (UniqueName: \"kubernetes.io/projected/9ee95329-5de6-43a8-9586-c8c9e58ad502-kube-api-access-bf8jh\") pod \"aws-ebs-csi-driver-node-gz5hj\" (UID: \"9ee95329-5de6-43a8-9586-c8c9e58ad502\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.455096 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.455069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjsg5\" (UniqueName: \"kubernetes.io/projected/f0d99c45-3518-42bc-82ab-266824513125-kube-api-access-tjsg5\") pod \"tuned-wjdjg\" (UID: \"f0d99c45-3518-42bc-82ab-266824513125\") " pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.536056 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.535998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n7k7f" Jun 09 02:21:43.546253 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.546233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmvnh" Jun 09 02:21:43.562885 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.562865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:21:43.566507 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.566487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktspj" Jun 09 02:21:43.575005 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.574986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" Jun 09 02:21:43.582578 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.582562 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmtlr" Jun 09 02:21:43.590339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.590322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:21:43.597930 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.597913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" Jun 09 02:21:43.604329 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.604314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" Jun 09 02:21:43.753538 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.753512 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 02:21:43.847498 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.847430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:43.847628 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.847497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:43.847628 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847574 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:43.847725 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847631 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:43.847725 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847656 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:43.847725 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847681 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:43.847725 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847634 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:44.84761906 +0000 UTC m=+4.009989285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:43.847903 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.847746 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:44.847730047 +0000 UTC m=+4.010100276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:43.947916 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:43.947881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:43.948093 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.948042 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:43.948157 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:43.948106 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:44.948086397 +0000 UTC m=+4.110456625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:44.269162 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.269050 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:16:43 +0000 UTC" deadline="2027-12-23 09:53:16.175167351 +0000 UTC" Jun 09 02:21:44.269162 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.269125 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h31m31.906060483s" Jun 09 02:21:44.303450 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.303429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:44.303583 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.303544 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:44.451560 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.451534 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2622c48b_c487_46c7_9a61_87dba1e9b2e8.slice/crio-2ecafe62851c8b925cd5a37619ce76ff6d16e6933dd9ee3767fed476d0abdcc5 WatchSource:0}: Error finding container 2ecafe62851c8b925cd5a37619ce76ff6d16e6933dd9ee3767fed476d0abdcc5: Status 404 returned error can't find the container with id 2ecafe62851c8b925cd5a37619ce76ff6d16e6933dd9ee3767fed476d0abdcc5 Jun 09 02:21:44.453526 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.453444 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad862208_0b48_4ca7_8e96_a191b51a273c.slice/crio-3f946f34ccaef4e6345f71a688ae8babd443be932e326cdc710a79d8688b8c78 WatchSource:0}: Error finding container 3f946f34ccaef4e6345f71a688ae8babd443be932e326cdc710a79d8688b8c78: Status 404 returned error can't find the container with id 3f946f34ccaef4e6345f71a688ae8babd443be932e326cdc710a79d8688b8c78 Jun 09 02:21:44.456332 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.456311 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef30b5e5_ab28_4ed4_98de_e3bf134130d1.slice/crio-12a21e1b5216f2ff7f6669102054c1934fd0d9dc5b7f3d790a1b867b00165128 WatchSource:0}: Error finding container 12a21e1b5216f2ff7f6669102054c1934fd0d9dc5b7f3d790a1b867b00165128: Status 404 returned error can't find the container with id 12a21e1b5216f2ff7f6669102054c1934fd0d9dc5b7f3d790a1b867b00165128 Jun 09 02:21:44.457626 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.457604 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5b1d7f_8fe9_40ae_a6d1_fc151817e377.slice/crio-ad9808eb0b6239e8fb0d4732639ae8379975a9d69076aa064e44a14b23e082b9 WatchSource:0}: Error finding container ad9808eb0b6239e8fb0d4732639ae8379975a9d69076aa064e44a14b23e082b9: Status 404 returned error can't find the container with id ad9808eb0b6239e8fb0d4732639ae8379975a9d69076aa064e44a14b23e082b9 Jun 09 02:21:44.458473 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.458449 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf354c442_b9c3_49db_b1ee_c72040a0f38c.slice/crio-b60b97e87fa7f83663b6f58ac438d1393efe3c3bba4daffccb2558be3a17a35c WatchSource:0}: Error finding container b60b97e87fa7f83663b6f58ac438d1393efe3c3bba4daffccb2558be3a17a35c: Status 404 returned error can't find the container with id b60b97e87fa7f83663b6f58ac438d1393efe3c3bba4daffccb2558be3a17a35c Jun 09 02:21:44.459300 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.459221 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf068f487_04d2_41d8_945a_1a75dbe44b63.slice/crio-2e6a57698ad908a2504544708fbdfc55968c628563e5d3d1c60b13d6d71d416a WatchSource:0}: Error finding container 2e6a57698ad908a2504544708fbdfc55968c628563e5d3d1c60b13d6d71d416a: Status 404 returned error can't find the container with id 2e6a57698ad908a2504544708fbdfc55968c628563e5d3d1c60b13d6d71d416a Jun 09 02:21:44.460177 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.460052 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5e0604_b335_411c_9874_c92dc2be2ef1.slice/crio-73d5898acf8d3c19fd6c52162ae7a7c451f79c7ff2f06aaa931db5f80ca72e5b WatchSource:0}: Error finding container 73d5898acf8d3c19fd6c52162ae7a7c451f79c7ff2f06aaa931db5f80ca72e5b: Status 404 returned error can't find the container with id 73d5898acf8d3c19fd6c52162ae7a7c451f79c7ff2f06aaa931db5f80ca72e5b Jun 09 02:21:44.461003 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.460918 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d99c45_3518_42bc_82ab_266824513125.slice/crio-beb1b594978fabbbec16491821bfe72e1d4134ae7a36ffbf5e0b6d0fb4b77224 WatchSource:0}: Error finding container beb1b594978fabbbec16491821bfe72e1d4134ae7a36ffbf5e0b6d0fb4b77224: Status 404 returned error can't find the container with id beb1b594978fabbbec16491821bfe72e1d4134ae7a36ffbf5e0b6d0fb4b77224 Jun 09 02:21:44.462911 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:21:44.462886 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee95329_5de6_43a8_9586_c8c9e58ad502.slice/crio-568d0960969ed6a5fa164da4c97d85b922f1e562709dcdf07cbca80c68f5905b WatchSource:0}: Error finding container 568d0960969ed6a5fa164da4c97d85b922f1e562709dcdf07cbca80c68f5905b: Status 404 returned error can't find the container with id 568d0960969ed6a5fa164da4c97d85b922f1e562709dcdf07cbca80c68f5905b Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.853589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.853887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.853898 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.853929 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.853944 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.853999 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:46.853980578 +0000 UTC m=+6.016350803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.854021 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:44.854155 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.854071 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:46.854056232 +0000 UTC m=+6.016426472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:44.955659 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:44.955109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:44.955659 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.955289 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:44.955659 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:44.955348 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:46.955330281 +0000 UTC m=+6.117700505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:45.270273 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.270164 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 02:16:43 +0000 UTC" deadline="2027-11-06 06:30:05.896938441 +0000 UTC" Jun 09 02:21:45.270273 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.270225 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12364h8m20.626716838s" Jun 09 02:21:45.305282 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.305252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:45.305430 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:45.305396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:45.305798 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.305763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:45.305885 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:45.305867 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:45.336883 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.336852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerStarted","Data":"73d5898acf8d3c19fd6c52162ae7a7c451f79c7ff2f06aaa931db5f80ca72e5b"} Jun 09 02:21:45.351040 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.351012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmtlr" event={"ID":"f068f487-04d2-41d8-945a-1a75dbe44b63","Type":"ContainerStarted","Data":"2e6a57698ad908a2504544708fbdfc55968c628563e5d3d1c60b13d6d71d416a"} Jun 09 02:21:45.354333 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.354261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vvwc" event={"ID":"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377","Type":"ContainerStarted","Data":"ad9808eb0b6239e8fb0d4732639ae8379975a9d69076aa064e44a14b23e082b9"} Jun 09 02:21:45.367974 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.367951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktspj" event={"ID":"ef30b5e5-ab28-4ed4-98de-e3bf134130d1","Type":"ContainerStarted","Data":"12a21e1b5216f2ff7f6669102054c1934fd0d9dc5b7f3d790a1b867b00165128"} Jun 09 02:21:45.372463 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.372438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"3f946f34ccaef4e6345f71a688ae8babd443be932e326cdc710a79d8688b8c78"} Jun 09 02:21:45.386790 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.386753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n7k7f" event={"ID":"2622c48b-c487-46c7-9a61-87dba1e9b2e8","Type":"ContainerStarted","Data":"2ecafe62851c8b925cd5a37619ce76ff6d16e6933dd9ee3767fed476d0abdcc5"} Jun 09 02:21:45.400019 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.399993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" event={"ID":"7b58dbed080db581ba525e909595b658","Type":"ContainerStarted","Data":"92e66907fd733839bce9ed6c74182d776d912887241584b79f48f9058c1e1a6c"} Jun 09 02:21:45.410930 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.410907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" event={"ID":"9ee95329-5de6-43a8-9586-c8c9e58ad502","Type":"ContainerStarted","Data":"568d0960969ed6a5fa164da4c97d85b922f1e562709dcdf07cbca80c68f5905b"} Jun 09 02:21:45.414094 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.414048 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-26.ec2.internal" podStartSLOduration=3.414030001 podStartE2EDuration="3.414030001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:21:45.41355564 +0000 UTC m=+4.575925874" watchObservedRunningTime="2026-06-09 02:21:45.414030001 +0000 UTC m=+4.576400246" Jun 09 02:21:45.416718 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.416694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmvnh" event={"ID":"f354c442-b9c3-49db-b1ee-c72040a0f38c","Type":"ContainerStarted","Data":"b60b97e87fa7f83663b6f58ac438d1393efe3c3bba4daffccb2558be3a17a35c"} Jun 09 02:21:45.427095 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.427063 2577 generic.go:356] "Generic (PLEG): container finished" podID="02feba71ffe676d909d3fccf76b03db3" containerID="8b0a0e1366fbc0a04199b6d9e6af2b46d0671013ba463b1be60fe5f257197cd3" exitCode=0 Jun 09 02:21:45.427316 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.427297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" event={"ID":"02feba71ffe676d909d3fccf76b03db3","Type":"ContainerDied","Data":"8b0a0e1366fbc0a04199b6d9e6af2b46d0671013ba463b1be60fe5f257197cd3"} Jun 09 02:21:45.438379 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:45.438354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" event={"ID":"f0d99c45-3518-42bc-82ab-266824513125","Type":"ContainerStarted","Data":"beb1b594978fabbbec16491821bfe72e1d4134ae7a36ffbf5e0b6d0fb4b77224"} Jun 09 02:21:46.303253 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.303222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:46.303754 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.303341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:46.450443 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.450370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" event={"ID":"02feba71ffe676d909d3fccf76b03db3","Type":"ContainerStarted","Data":"cb3efc8fa911dfe674c68053b255fe3fdfcdf300ae5d2bb4dbd5b3a38de44823"} Jun 09 02:21:46.465706 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.465642 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-26.ec2.internal" podStartSLOduration=4.465623745 podStartE2EDuration="4.465623745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:21:46.464798342 +0000 UTC m=+5.627168579" watchObservedRunningTime="2026-06-09 02:21:46.465623745 +0000 UTC m=+5.627993986" Jun 09 02:21:46.869505 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.869468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:46.869686 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.869528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:46.869753 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869699 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:46.869820 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:50.869740987 +0000 UTC m=+10.032111211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:46.869883 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869865 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:46.869931 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869885 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:46.869931 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869899 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:46.870086 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.869937 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:50.869924374 +0000 UTC m=+10.032294615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:46.971161 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:46.970590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:46.971161 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.970761 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:46.971161 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:46.970833 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:50.970816008 +0000 UTC m=+10.133186235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:47.303463 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:47.303434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:47.303930 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:47.303579 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:47.304001 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:47.303935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:47.304054 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:47.304026 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:48.302891 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:48.302580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:48.302891 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:48.302741 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:49.304251 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:49.303578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:49.304251 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:49.303713 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:49.304251 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:49.304123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:49.304251 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:49.304213 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:50.302923 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:50.302884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:50.303114 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.303021 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:50.905049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:50.905098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905261 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:58.905298552 +0000 UTC m=+18.067668782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905719 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905743 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:50.905758 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905761 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:50.906552 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:50.905825 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:58.905810077 +0000 UTC m=+18.068180303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:51.005870 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:51.005761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:51.006044 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:51.005893 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:51.006044 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:51.005963 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:21:59.005943936 +0000 UTC m=+18.168314159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:51.305917 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:51.305885 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:51.306088 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:51.306022 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:51.306399 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:51.306375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:51.306495 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:51.306476 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:52.303253 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:52.303219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:52.303797 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:52.303358 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:53.303078 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:53.302914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:53.303078 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:53.302955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:53.303078 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:53.303045 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:53.303630 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:53.303194 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:54.303150 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:54.303116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:54.303312 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:54.303247 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:55.302585 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:55.302558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:55.302754 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:55.302677 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:55.302754 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:55.302711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:55.302881 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:55.302849 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:56.303253 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:56.303218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:56.303659 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:56.303318 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:57.302855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:57.302795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:57.302855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:57.302834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:57.303083 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:57.302917 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:57.303150 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:57.303073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:21:58.302700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:58.302667 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:58.303137 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.302807 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:21:58.962965 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:58.962931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:58.962965 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:58.962971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963087 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963107 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963126 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963138 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:14.963130647 +0000 UTC m=+34.125501083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:21:58.963205 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:58.963175 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:14.963166448 +0000 UTC m=+34.125536681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:21:59.063665 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:59.063629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:21:59.063824 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:59.063754 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:59.063892 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:59.063831 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:15.063812413 +0000 UTC m=+34.226182660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:21:59.303084 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:59.303055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:21:59.303541 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:21:59.303066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:21:59.303541 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:59.303180 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:21:59.303541 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:21:59.303256 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:00.302746 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:00.302714 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:00.302944 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:00.302856 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:01.303428 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:01.303394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:01.303873 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:01.303495 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:01.303873 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:01.303573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:01.303873 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:01.303693 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:02.303048 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:02.303012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:02.303209 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:02.303138 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:03.303090 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.302783 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:03.303090 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.302783 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:03.303090 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:03.303053 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:03.303717 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:03.303154 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:03.487565 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.487470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" event={"ID":"f0d99c45-3518-42bc-82ab-266824513125","Type":"ContainerStarted","Data":"85efaa1abe165191ec9be8e55bbd065c807de905cf29fb58e7c69ef8d121c9ab"} Jun 09 02:22:03.488966 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.488938 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="da0cf0b62128be91a6086a02088532b39ae7c10eaabb87630ab018b03e248c84" exitCode=0 Jun 09 02:22:03.489101 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.488967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"da0cf0b62128be91a6086a02088532b39ae7c10eaabb87630ab018b03e248c84"} Jun 09 02:22:03.490614 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.490591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmtlr" event={"ID":"f068f487-04d2-41d8-945a-1a75dbe44b63","Type":"ContainerStarted","Data":"8ff61498a606744446584627aae8ab8d5914219a674b4b07ee302434e79e0ee4"} Jun 09 02:22:03.492138 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.492120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vvwc" event={"ID":"8d5b1d7f-8fe9-40ae-a6d1-fc151817e377","Type":"ContainerStarted","Data":"0b09fe10b6e5111dceff5b73fd24219314a60d3b8e604e155b7d9a0924260b33"} Jun 09 02:22:03.493684 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.493660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktspj" event={"ID":"ef30b5e5-ab28-4ed4-98de-e3bf134130d1","Type":"ContainerStarted","Data":"f74b4d22b09ef2eaef92c009399067bdf048287d32e3e4427f8e36ec45ee32b1"} Jun 09 02:22:03.496932 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.496914 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:22:03.497252 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497233 2577 generic.go:356] "Generic (PLEG): container finished" podID="ad862208-0b48-4ca7-8e96-a191b51a273c" containerID="f5eef4a6ffab805b296491c62346bd294230ae6d9191541108351458e4927f94" exitCode=1 Jun 09 02:22:03.497319 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"32cb09c13ac82e55109916a899ea04ded063c464edccc833761cf35e127fbcaa"} Jun 09 02:22:03.497374 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"bd848ee2fb1b2b6131bde16818a414998b7f5b986fcc355c827902710a6fa702"} Jun 09 02:22:03.497428 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"4d2eb4317e6de6239678b6b1f9fb7a3f67459581246d7a8f46d5aeec0f7246bf"} Jun 09 02:22:03.497428 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"d45f4a5e0992d7b95d14c96e7d17a63e660acd279ace7b5c6f9406087a9cd350"} Jun 09 02:22:03.497509 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerDied","Data":"f5eef4a6ffab805b296491c62346bd294230ae6d9191541108351458e4927f94"} Jun 09 02:22:03.497509 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.497486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"e49cf45d9f36d256bb0be646073bd263429ff5c22fecb16e793b220670ad75de"} Jun 09 02:22:03.498635 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.498613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" event={"ID":"9ee95329-5de6-43a8-9586-c8c9e58ad502","Type":"ContainerStarted","Data":"424bd9c14685fbf92f7e4abb1449a7cd05a6030d632166a6a9bb68e7509b8d2b"} Jun 09 02:22:03.500051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.500030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmvnh" event={"ID":"f354c442-b9c3-49db-b1ee-c72040a0f38c","Type":"ContainerStarted","Data":"c49d7bc0036cc6f1341e84d0d0d8f682779b565984353fb2180819daa2cd35b7"} Jun 09 02:22:03.502659 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.502617 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wjdjg" podStartSLOduration=4.254784085 podStartE2EDuration="22.502606313s" totalImagesPullingTime="18.247822228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:03.502161379 +0000 UTC m=+22.664531623" watchObservedRunningTime="2026-06-09 02:22:03.502606313 +0000 UTC m=+22.664976556" Jun 09 02:22:03.557579 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.557539 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fmvnh" podStartSLOduration=4.309004378 podStartE2EDuration="22.557524835s" totalImagesPullingTime="18.248520457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:03.557430637 +0000 UTC m=+22.719800882" watchObservedRunningTime="2026-06-09 02:22:03.557524835 +0000 UTC m=+22.719895083" Jun 09 02:22:03.557704 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.557686 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xmtlr" podStartSLOduration=4.280209616 podStartE2EDuration="22.557681229s" totalImagesPullingTime="18.277471613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:03.542678812 +0000 UTC m=+22.705049057" watchObservedRunningTime="2026-06-09 02:22:03.557681229 +0000 UTC m=+22.720051472" Jun 09 02:22:03.569990 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.569949 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ktspj" podStartSLOduration=4.319183656 podStartE2EDuration="22.569936093s" totalImagesPullingTime="18.250752437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:03.569712506 +0000 UTC m=+22.732082749" watchObservedRunningTime="2026-06-09 02:22:03.569936093 +0000 UTC m=+22.732306338" Jun 09 02:22:03.583235 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.583204 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9vvwc" podStartSLOduration=12.452146459 podStartE2EDuration="22.583191131s" totalImagesPullingTime="10.131044672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:03.582706008 +0000 UTC m=+22.745076253" watchObservedRunningTime="2026-06-09 02:22:03.583191131 +0000 UTC m=+22.745561377" Jun 09 02:22:03.736715 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:03.736690 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 02:22:04.302538 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.302506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:04.302719 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:04.302614 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:04.303539 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.303454 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T02:22:03.736711382Z","UUID":"b0bf9ef6-9714-4860-8864-f1110812a444","Handler":null,"Name":"","Endpoint":""} Jun 09 02:22:04.306200 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.305968 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 02:22:04.306200 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.306023 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 02:22:04.503663 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.503631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n7k7f" event={"ID":"2622c48b-c487-46c7-9a61-87dba1e9b2e8","Type":"ContainerStarted","Data":"02c8a0262e506a5f1a9c000275c6eba8ed091a6dd8c3cd591a540523fbc5385d"} Jun 09 02:22:04.505282 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.505254 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" event={"ID":"9ee95329-5de6-43a8-9586-c8c9e58ad502","Type":"ContainerStarted","Data":"42711e177e77329974db26f423281bf100afda338c9a89a7b40a95272596c63a"} Jun 09 02:22:04.516431 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.516393 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n7k7f" podStartSLOduration=5.260365735 podStartE2EDuration="23.516382526s" totalImagesPullingTime="18.256016791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:04.516035356 +0000 UTC m=+23.678405600" watchObservedRunningTime="2026-06-09 02:22:04.516382526 +0000 UTC m=+23.678752770" Jun 09 02:22:04.979761 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:04.979679 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:22:05.302841 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.302812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:05.302981 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.302844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:05.302981 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:05.302919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:05.303068 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:05.303050 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:05.462838 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.462763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:22:05.463492 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.463464 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:22:05.510936 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.510911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:22:05.511406 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.511375 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"1fd325f0a7ac0542bbafdb943455fedddd1a2ab9a0c033e467a459edd1f9c01a"} Jun 09 02:22:05.513708 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.513640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" event={"ID":"9ee95329-5de6-43a8-9586-c8c9e58ad502","Type":"ContainerStarted","Data":"5cee5dbf9ddcbebe6a2e9587813ae768c53bec193e5790c4bc7c03877b6beeb8"} Jun 09 02:22:05.514397 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.514380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9vvwc" Jun 09 02:22:05.528751 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:05.528715 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz5hj" podStartSLOduration=4.805771382 podStartE2EDuration="24.528700993s" totalImagesPullingTime="19.722929611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:05.528505229 +0000 UTC m=+24.690875475" watchObservedRunningTime="2026-06-09 02:22:05.528700993 +0000 UTC m=+24.691071236" Jun 09 02:22:06.302869 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:06.302842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:06.303796 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:06.303313 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:07.303104 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:07.303077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:07.303613 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:07.303208 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:07.303613 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:07.303269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:07.303613 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:07.303400 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:08.303410 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.303390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:08.304108 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:08.303501 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:08.522899 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.522723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:22:08.523230 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.523209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"dab3e0d6547f8b0af3720f3968542fb3f038c5eb1d71e268d04980b81e3c3fbe"} Jun 09 02:22:08.531477 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.531406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:08.531535 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.531477 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:08.531590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.531574 2577 scope.go:117] "RemoveContainer" containerID="f5eef4a6ffab805b296491c62346bd294230ae6d9191541108351458e4927f94" Jun 09 02:22:08.549956 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:08.549933 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:09.303312 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.303278 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:09.303439 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:09.303396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:09.303684 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.303444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:09.303684 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:09.303528 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:09.527233 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.527206 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="3702738c815f7fc80c1be28c0a1cbe128c22b6f1659e49924d833f92c806030f" exitCode=0 Jun 09 02:22:09.527376 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.527292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"3702738c815f7fc80c1be28c0a1cbe128c22b6f1659e49924d833f92c806030f"} Jun 09 02:22:09.531064 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.531046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:22:09.531481 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.531451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" event={"ID":"ad862208-0b48-4ca7-8e96-a191b51a273c","Type":"ContainerStarted","Data":"a5f59812184b99ec2920b8a85f6bf4b57b63c1097a5e235ccfab7b16a49345be"} Jun 09 02:22:09.531731 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.531717 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:09.545808 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.545789 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:09.570247 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:09.570207 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" podStartSLOduration=10.253153318 podStartE2EDuration="28.570196152s" totalImagesPullingTime="18.317042834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:09.568741667 +0000 UTC m=+28.731111910" watchObservedRunningTime="2026-06-09 02:22:09.570196152 +0000 UTC m=+28.732566400" Jun 09 02:22:10.302658 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.302631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:10.302831 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:10.302733 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:10.415366 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.415340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sv5q"] Jun 09 02:22:10.418858 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.418820 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvf66"] Jun 09 02:22:10.419008 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.418960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:10.419105 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:10.419083 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:10.419390 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.419370 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff6vw"] Jun 09 02:22:10.419489 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.419442 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:10.419543 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:10.419526 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:10.533133 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:10.533112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:10.533266 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:10.533190 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:11.537074 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:11.537045 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="08d03dc3df6ae9fee62fffa92e5bd4dca7fdf782112e24041aaa9c22b7840197" exitCode=0 Jun 09 02:22:11.537428 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:11.537109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"08d03dc3df6ae9fee62fffa92e5bd4dca7fdf782112e24041aaa9c22b7840197"} Jun 09 02:22:12.303069 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:12.302899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:12.303175 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:12.302899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:12.303175 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:12.303148 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:12.303284 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:12.302899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:12.303284 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:12.303212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:12.303369 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:12.303307 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:13.543518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:13.543488 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="84f350bcef2806cddf0681f6d4b477f36ede590e6fb6907da086e6cb76b6d9a7" exitCode=0 Jun 09 02:22:13.543986 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:13.543527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"84f350bcef2806cddf0681f6d4b477f36ede590e6fb6907da086e6cb76b6d9a7"} Jun 09 02:22:14.303240 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.303206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:14.303517 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.303206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:14.303517 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.303352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:22:14.303517 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.303206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:14.303517 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.303430 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff6vw" podUID="c7dc903d-d402-483b-b2b8-f52759d46d56" Jun 09 02:22:14.303738 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.303546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sv5q" podUID="8da81d0b-243e-478c-8f74-064a6c8a56b4" Jun 09 02:22:14.615317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.615245 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-26.ec2.internal" event="NodeReady" Jun 09 02:22:14.615702 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.615364 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 02:22:14.645692 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.645667 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6"] Jun 09 02:22:14.666341 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.666315 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j"] Jun 09 02:22:14.666472 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.666445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.668750 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.668730 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 02:22:14.668886 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.668789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 02:22:14.668886 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.668847 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bpdmb\"" Jun 09 02:22:14.669023 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.669005 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 02:22:14.669141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.669055 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 02:22:14.682324 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.682301 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:22:14.682446 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.682428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.685314 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.685295 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 02:22:14.700419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.700401 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd"] Jun 09 02:22:14.700545 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.700527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.702624 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.702552 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 02:22:14.702913 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.702571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8sdz2\"" Jun 09 02:22:14.703098 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.703069 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 02:22:14.703302 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.703287 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 02:22:14.711730 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.711707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 02:22:14.722022 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.721997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6"] Jun 09 02:22:14.722123 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.722027 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5x42p"] Jun 09 02:22:14.722123 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.722113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.724221 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.724183 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 02:22:14.724221 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.724198 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 02:22:14.724385 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.724230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 02:22:14.724385 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.724198 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 02:22:14.744065 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.744045 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j"] Jun 09 02:22:14.744158 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.744084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd"] Jun 09 02:22:14.744158 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.744106 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gxpgm"] Jun 09 02:22:14.744254 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.744198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:14.746478 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.746458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 02:22:14.746588 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.746549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 02:22:14.746723 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.746693 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 02:22:14.760401 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.760384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wrbqm\"" Jun 09 02:22:14.761163 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.761148 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5x42p"] Jun 09 02:22:14.761236 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.761171 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxpgm"] Jun 09 02:22:14.761236 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.761187 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:22:14.761301 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.761283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.763208 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.763176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 02:22:14.763307 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.763216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rpcr5\"" Jun 09 02:22:14.763419 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.763404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 02:22:14.795515 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.795613 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk5jr\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.795613 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.795707 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.795707 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.795793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfa0726-ae9e-4d23-8f69-900462743141-tmp\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.795793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7ccg\" (UniqueName: \"kubernetes.io/projected/7588b13e-6583-450c-888c-9af0cb65cc60-kube-api-access-n7ccg\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.795879 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckv6v\" (UniqueName: \"kubernetes.io/projected/acfa0726-ae9e-4d23-8f69-900462743141-kube-api-access-ckv6v\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.795879 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acfa0726-ae9e-4d23-8f69-900462743141-klusterlet-config\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.795956 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7588b13e-6583-450c-888c-9af0cb65cc60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.795956 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.796051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.795959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.796051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.796009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.813876 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.813845 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vvwc_8d5b1d7f-8fe9-40ae-a6d1-fc151817e377/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:14.894374 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.894308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vvwc_8d5b1d7f-8fe9-40ae-a6d1-fc151817e377/konnectivity-agent/0.log" limit=1024 Jun 09 02:22:14.896371 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfa0726-ae9e-4d23-8f69-900462743141-tmp\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.896460 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c851bf2f-3504-4317-af6c-165888f67ebc-tmp-dir\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.896460 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7ccg\" (UniqueName: \"kubernetes.io/projected/7588b13e-6583-450c-888c-9af0cb65cc60-kube-api-access-n7ccg\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.896586 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d241d1-fd09-42c9-9219-ae11a13be160-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.896586 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d58419f-147f-4c7f-a92f-14abf07f6b6a-cert\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:14.896586 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckv6v\" (UniqueName: \"kubernetes.io/projected/acfa0726-ae9e-4d23-8f69-900462743141-kube-api-access-ckv6v\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acfa0726-ae9e-4d23-8f69-900462743141-klusterlet-config\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7588b13e-6583-450c-888c-9af0cb65cc60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acfa0726-ae9e-4d23-8f69-900462743141-tmp\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.896734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.896792 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.896809 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.896875 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:15.396857644 +0000 UTC m=+34.559227866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk5jr\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54mwh\" (UniqueName: \"kubernetes.io/projected/94d241d1-fd09-42c9-9219-ae11a13be160-kube-api-access-54mwh\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c851bf2f-3504-4317-af6c-165888f67ebc-config-volume\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.896983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9v7\" (UniqueName: \"kubernetes.io/projected/c851bf2f-3504-4317-af6c-165888f67ebc-kube-api-access-4h9v7\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897077 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.897757 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.897757 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrj6j\" (UniqueName: \"kubernetes.io/projected/6d58419f-147f-4c7f-a92f-14abf07f6b6a-kube-api-access-xrj6j\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:14.897890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.897818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.898037 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.898014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.898495 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.898467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.901035 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.901012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.901035 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.901027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.901192 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.901137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acfa0726-ae9e-4d23-8f69-900462743141-klusterlet-config\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.901253 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.901200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7588b13e-6583-450c-888c-9af0cb65cc60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.904946 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.904919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7ccg\" (UniqueName: \"kubernetes.io/projected/7588b13e-6583-450c-888c-9af0cb65cc60-kube-api-access-n7ccg\") pod \"managed-serviceaccount-addon-agent-59b6444cb8-l78h6\" (UID: \"7588b13e-6583-450c-888c-9af0cb65cc60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.905307 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.905289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk5jr\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.905647 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.905631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckv6v\" (UniqueName: \"kubernetes.io/projected/acfa0726-ae9e-4d23-8f69-900462743141-kube-api-access-ckv6v\") pod \"klusterlet-addon-workmgr-856d6c8bc6-mvz8j\" (UID: \"acfa0726-ae9e-4d23-8f69-900462743141\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.905961 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.905942 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:14.985005 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.984985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:22:14.994143 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.994121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:14.998438 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c851bf2f-3504-4317-af6c-165888f67ebc-tmp-dir\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.998542 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:14.998542 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d241d1-fd09-42c9-9219-ae11a13be160-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.998542 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d58419f-147f-4c7f-a92f-14abf07f6b6a-cert\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.998643 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54mwh\" (UniqueName: \"kubernetes.io/projected/94d241d1-fd09-42c9-9219-ae11a13be160-kube-api-access-54mwh\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.998700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c851bf2f-3504-4317-af6c-165888f67ebc-config-volume\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.998714 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:46.998695414 +0000 UTC m=+66.161065636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9v7\" (UniqueName: \"kubernetes.io/projected/c851bf2f-3504-4317-af6c-165888f67ebc-kube-api-access-4h9v7\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrj6j\" (UniqueName: \"kubernetes.io/projected/6d58419f-147f-4c7f-a92f-14abf07f6b6a-kube-api-access-xrj6j\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.998965 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.998982 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.998995 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rzwpj for pod openshift-network-diagnostics/network-check-target-ff6vw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:22:14.999116 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.999041 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj podName:c7dc903d-d402-483b-b2b8-f52759d46d56 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:46.999021552 +0000 UTC m=+66.161391774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rzwpj" (UniqueName: "kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj") pod "network-check-target-ff6vw" (UID: "c7dc903d-d402-483b-b2b8-f52759d46d56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 02:22:14.999579 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.999177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c851bf2f-3504-4317-af6c-165888f67ebc-config-volume\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:14.999579 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.999199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94d241d1-fd09-42c9-9219-ae11a13be160-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:14.999579 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.999387 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:14.999579 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:14.999441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:15.499424645 +0000 UTC m=+34.661794869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:14.999579 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:14.998754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c851bf2f-3504-4317-af6c-165888f67ebc-tmp-dir\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:15.001281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.001259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.001671 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.001647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.001929 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.001899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-hub\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.001997 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.001936 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d58419f-147f-4c7f-a92f-14abf07f6b6a-cert\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:15.002236 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.002217 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94d241d1-fd09-42c9-9219-ae11a13be160-ca\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.007237 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.007215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrj6j\" (UniqueName: \"kubernetes.io/projected/6d58419f-147f-4c7f-a92f-14abf07f6b6a-kube-api-access-xrj6j\") pod \"ingress-canary-5x42p\" (UID: \"6d58419f-147f-4c7f-a92f-14abf07f6b6a\") " pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:15.007385 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.007365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9v7\" (UniqueName: \"kubernetes.io/projected/c851bf2f-3504-4317-af6c-165888f67ebc-kube-api-access-4h9v7\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:15.007558 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.007538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54mwh\" (UniqueName: \"kubernetes.io/projected/94d241d1-fd09-42c9-9219-ae11a13be160-kube-api-access-54mwh\") pod \"cluster-proxy-proxy-agent-85c46b6fff-l5qfd\" (UID: \"94d241d1-fd09-42c9-9219-ae11a13be160\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.031474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.031454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:22:15.066286 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.066260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5x42p" Jun 09 02:22:15.100848 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.099886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:15.100848 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.100121 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 02:22:15.100848 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.100197 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret podName:8da81d0b-243e-478c-8f74-064a6c8a56b4 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:47.10017879 +0000 UTC m=+66.262549031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret") pod "global-pull-secret-syncer-6sv5q" (UID: "8da81d0b-243e-478c-8f74-064a6c8a56b4") : object "kube-system"/"original-pull-secret" not registered Jun 09 02:22:15.214847 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.214608 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6"] Jun 09 02:22:15.229697 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.229671 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j"] Jun 09 02:22:15.233146 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.233115 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd"] Jun 09 02:22:15.233696 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:22:15.233669 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfa0726_ae9e_4d23_8f69_900462743141.slice/crio-8bafd429737ed86aa942f296a0d6c7ac907f5afd95237b90819fc1b859fde180 WatchSource:0}: Error finding container 8bafd429737ed86aa942f296a0d6c7ac907f5afd95237b90819fc1b859fde180: Status 404 returned error can't find the container with id 8bafd429737ed86aa942f296a0d6c7ac907f5afd95237b90819fc1b859fde180 Jun 09 02:22:15.236656 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:22:15.236568 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94d241d1_fd09_42c9_9219_ae11a13be160.slice/crio-df1a1e8b41244184d6bf3bbd1655d349619aaf230f166dce12224dea9c24b780 WatchSource:0}: Error finding container df1a1e8b41244184d6bf3bbd1655d349619aaf230f166dce12224dea9c24b780: Status 404 returned error can't find the container with id df1a1e8b41244184d6bf3bbd1655d349619aaf230f166dce12224dea9c24b780 Jun 09 02:22:15.255172 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.255144 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5x42p"] Jun 09 02:22:15.257882 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:22:15.257859 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d58419f_147f_4c7f_a92f_14abf07f6b6a.slice/crio-1cbb6fc074996d191d2b2559149d4b9f3fb055fb6fb5061c19991462d55b8968 WatchSource:0}: Error finding container 1cbb6fc074996d191d2b2559149d4b9f3fb055fb6fb5061c19991462d55b8968: Status 404 returned error can't find the container with id 1cbb6fc074996d191d2b2559149d4b9f3fb055fb6fb5061c19991462d55b8968 Jun 09 02:22:15.402557 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.402527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:15.405747 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.403085 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:15.405747 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.403113 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:15.405747 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.403179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:16.403160077 +0000 UTC m=+35.565530315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:15.503420 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.503339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:15.503524 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.503492 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:15.503574 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:15.503545 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:16.503532252 +0000 UTC m=+35.665902477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:15.549381 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.549353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerStarted","Data":"a4392038f3fc157059fa6cdb08e527a9f62245452149176366983fc18edc9ef6"} Jun 09 02:22:15.550518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.550489 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerStarted","Data":"df1a1e8b41244184d6bf3bbd1655d349619aaf230f166dce12224dea9c24b780"} Jun 09 02:22:15.551709 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.551686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5x42p" event={"ID":"6d58419f-147f-4c7f-a92f-14abf07f6b6a","Type":"ContainerStarted","Data":"1cbb6fc074996d191d2b2559149d4b9f3fb055fb6fb5061c19991462d55b8968"} Jun 09 02:22:15.552729 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:15.552710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerStarted","Data":"8bafd429737ed86aa942f296a0d6c7ac907f5afd95237b90819fc1b859fde180"} Jun 09 02:22:16.304135 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.303162 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:16.304135 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.303616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:16.304135 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.304005 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:16.306397 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.306225 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:22:16.308500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.307012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:22:16.308500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.307294 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47r67\"" Jun 09 02:22:16.308500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.307553 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:22:16.308500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.307785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:22:16.308500 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.308017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqw9m\"" Jun 09 02:22:16.411313 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.410727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:16.411313 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:16.410904 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:16.411313 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:16.410921 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:16.411313 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:16.410975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:18.410957114 +0000 UTC m=+37.573327351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:16.511961 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:16.511925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:16.512175 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:16.512156 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:16.512263 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:16.512224 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:18.512206566 +0000 UTC m=+37.674576791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:18.430971 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:18.430931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:18.431427 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:18.431113 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:18.431427 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:18.431134 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:18.431427 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:18.431214 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:22.431191321 +0000 UTC m=+41.593561543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:18.532040 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:18.532007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:18.532221 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:18.532210 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:18.532301 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:18.532275 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:22.532255157 +0000 UTC m=+41.694625402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:22.462393 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:22.462353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:22.463004 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:22.462510 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:22.463004 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:22.462529 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:22.463004 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:22.462587 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:30.462568554 +0000 UTC m=+49.624938776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:22.562740 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:22.562710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:22.562925 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:22.562886 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:22.562988 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:22.562952 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:30.562936109 +0000 UTC m=+49.725306331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:25.583864 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.583799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerStarted","Data":"99ed43f1b51bc2314b37c20fb4b18fd8134c9b72fd8ebdfcf6e809b2d26de416"} Jun 09 02:22:25.583864 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.583852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerStarted","Data":"d87342f46fcdd1e5c612525f1668499f46a68b1f3733a1ea3eb7608959b7962d"} Jun 09 02:22:25.584311 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.583870 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerStarted","Data":"b811039468d891359fa820c0f0beefd0c3449eb1946fa47235ef4853cb70dcbc"} Jun 09 02:22:25.585217 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.585191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5x42p" event={"ID":"6d58419f-147f-4c7f-a92f-14abf07f6b6a","Type":"ContainerStarted","Data":"f6642246b0bc6249d5a5d42cbd6d09aa625ad691c520ffcab7f74c7b9cc2f62d"} Jun 09 02:22:25.586568 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.586548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerStarted","Data":"b9252780b1b4d21801f75ea42060cbca9601098dbdf7418bcb6392e77f20035c"} Jun 09 02:22:25.586680 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.586663 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:25.588463 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.588436 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:22:25.589516 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.589498 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="de5b7a13302323bf4e0963b45f61005ec635bcfb4376bd2e98e9f08c0b4db1ec" exitCode=0 Jun 09 02:22:25.589574 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.589531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"de5b7a13302323bf4e0963b45f61005ec635bcfb4376bd2e98e9f08c0b4db1ec"} Jun 09 02:22:25.590919 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.590901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerStarted","Data":"629c755914aa021a881a7d15c5b0c68375940cf8ac6488115d140c2a4f8c9f14"} Jun 09 02:22:25.603333 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.603293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" podStartSLOduration=18.621200686999998 podStartE2EDuration="28.603281434s" totalImagesPullingTime="9.982080747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:25.602233412 +0000 UTC m=+44.764603658" watchObservedRunningTime="2026-06-09 02:22:25.603281434 +0000 UTC m=+44.765651656" Jun 09 02:22:25.634846 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.634810 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" podStartSLOduration=18.629029912 podStartE2EDuration="28.634798054s" totalImagesPullingTime="10.005768142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:25.633390933 +0000 UTC m=+44.795761179" watchObservedRunningTime="2026-06-09 02:22:25.634798054 +0000 UTC m=+44.797168297" Jun 09 02:22:25.646719 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.646681 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" podStartSLOduration=18.662031679000002 podStartE2EDuration="28.646670014s" totalImagesPullingTime="9.984638335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:25.646186085 +0000 UTC m=+44.808556331" watchObservedRunningTime="2026-06-09 02:22:25.646670014 +0000 UTC m=+44.809040276" Jun 09 02:22:25.665048 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:25.665016 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5x42p" podStartSLOduration=1.7345432 podStartE2EDuration="11.665005411s" totalImagesPullingTime="9.930462211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:25.664483348 +0000 UTC m=+44.826853603" watchObservedRunningTime="2026-06-09 02:22:25.665005411 +0000 UTC m=+44.827375654" Jun 09 02:22:26.598207 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:26.598172 2577 generic.go:356] "Generic (PLEG): container finished" podID="2a5e0604-b335-411c-9874-c92dc2be2ef1" containerID="cbf8f29b61f1cc0e345fcb81e27fc5e9ec46801378cfe42c7889143caae48070" exitCode=0 Jun 09 02:22:26.598736 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:26.598262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerDied","Data":"cbf8f29b61f1cc0e345fcb81e27fc5e9ec46801378cfe42c7889143caae48070"} Jun 09 02:22:27.606130 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:27.606084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" event={"ID":"2a5e0604-b335-411c-9874-c92dc2be2ef1","Type":"ContainerStarted","Data":"fd6dac4e85ef90b33f18f7dc8889c92ad6da0be88a0e1f72dccbd3d11437574b"} Jun 09 02:22:27.626227 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:27.626178 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7hkbk" podStartSLOduration=9.748065099 podStartE2EDuration="46.6261644s" totalImagesPullingTime="36.878099301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:27.625026812 +0000 UTC m=+46.787397117" watchObservedRunningTime="2026-06-09 02:22:27.6261644 +0000 UTC m=+46.788534643" Jun 09 02:22:30.519663 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:30.519629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:30.520057 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:30.519754 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:30.520057 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:30.519766 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:30.520057 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:30.519836 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:22:46.519822482 +0000 UTC m=+65.682192703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:30.620807 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:30.620756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:30.620932 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:30.620895 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:30.620966 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:30.620952 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:22:46.620938835 +0000 UTC m=+65.783309087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:41.557918 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:41.557892 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cxm7c" Jun 09 02:22:46.535237 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:46.535197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:22:46.535666 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:46.535363 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:22:46.535666 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:46.535382 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:22:46.535666 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:46.535442 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:18.535426119 +0000 UTC m=+97.697796344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:22:46.635651 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:46.635618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:22:46.635804 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:46.635760 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:22:46.635850 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:46.635839 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:23:18.635822452 +0000 UTC m=+97.798192677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:22:47.038485 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.038457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:47.038642 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.038493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:22:47.040951 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.040926 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 02:22:47.040995 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.040977 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 02:22:47.048776 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:47.048756 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:22:47.048863 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:22:47.048851 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:23:51.048833724 +0000 UTC m=+130.211203946 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : secret "metrics-daemon-secret" not found Jun 09 02:22:47.050613 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.050595 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 02:22:47.062190 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.062163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzwpj\" (UniqueName: \"kubernetes.io/projected/c7dc903d-d402-483b-b2b8-f52759d46d56-kube-api-access-rzwpj\") pod \"network-check-target-ff6vw\" (UID: \"c7dc903d-d402-483b-b2b8-f52759d46d56\") " pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:47.139355 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.139323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:47.141402 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.141385 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 02:22:47.152379 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.152358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da81d0b-243e-478c-8f74-064a6c8a56b4-original-pull-secret\") pod \"global-pull-secret-syncer-6sv5q\" (UID: \"8da81d0b-243e-478c-8f74-064a6c8a56b4\") " pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:47.220891 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.220856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sv5q" Jun 09 02:22:47.232909 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.232887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47r67\"" Jun 09 02:22:47.240941 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.240918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:47.352071 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.352044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sv5q"] Jun 09 02:22:47.370469 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.370447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff6vw"] Jun 09 02:22:47.373271 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:22:47.373251 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dc903d_d402_483b_b2b8_f52759d46d56.slice/crio-e5d8c26a75de844575b240d54038fa1bb2d670eaf0b9fa4f261be9b34e7e54d1 WatchSource:0}: Error finding container e5d8c26a75de844575b240d54038fa1bb2d670eaf0b9fa4f261be9b34e7e54d1: Status 404 returned error can't find the container with id e5d8c26a75de844575b240d54038fa1bb2d670eaf0b9fa4f261be9b34e7e54d1 Jun 09 02:22:47.668032 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.667955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sv5q" event={"ID":"8da81d0b-243e-478c-8f74-064a6c8a56b4","Type":"ContainerStarted","Data":"17fd1c0e6d3926df10edde45d6961798413be20502174370431af7714f2d03ac"} Jun 09 02:22:47.669222 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:47.669193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff6vw" event={"ID":"c7dc903d-d402-483b-b2b8-f52759d46d56","Type":"ContainerStarted","Data":"e5d8c26a75de844575b240d54038fa1bb2d670eaf0b9fa4f261be9b34e7e54d1"} Jun 09 02:22:52.687029 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:52.686976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff6vw" event={"ID":"c7dc903d-d402-483b-b2b8-f52759d46d56","Type":"ContainerStarted","Data":"828602fdadebb88fed16b1546afcbb64a8baae4d06a58ac687829e86c8b92b7c"} Jun 09 02:22:52.687593 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:52.687118 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:22:52.688645 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:52.688616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sv5q" event={"ID":"8da81d0b-243e-478c-8f74-064a6c8a56b4","Type":"ContainerStarted","Data":"14c1949417beb7e854437a2ad408849bc7f8b068a0601604698f8bc5f910c79c"} Jun 09 02:22:52.702443 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:52.702394 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ff6vw" podStartSLOduration=67.357193397 podStartE2EDuration="1m11.702380388s" totalImagesPullingTime="4.345186991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:52.700715364 +0000 UTC m=+71.863085609" watchObservedRunningTime="2026-06-09 02:22:52.702380388 +0000 UTC m=+71.864750632" Jun 09 02:22:52.712852 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:22:52.712812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6sv5q" podStartSLOduration=67.347645853 podStartE2EDuration="1m11.712798782s" totalImagesPullingTime="4.365152929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:22:52.712644554 +0000 UTC m=+71.875014799" watchObservedRunningTime="2026-06-09 02:22:52.712798782 +0000 UTC m=+71.875169040" Jun 09 02:23:18.559118 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:23:18.559079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:23:18.559475 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:18.559229 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:23:18.559475 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:18.559246 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:23:18.559475 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:18.559301 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:24:22.559284655 +0000 UTC m=+161.721654917 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:23:18.659704 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:23:18.659666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:23:18.659870 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:18.659831 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:23:18.659910 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:18.659895 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:24:22.659878076 +0000 UTC m=+161.822248299 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:23:23.693156 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:23:23.693123 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ff6vw" Jun 09 02:23:51.081476 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:23:51.081425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:23:51.081891 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:51.081554 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 02:23:51.081891 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:23:51.081614 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs podName:53c8ff5a-405e-44f9-88a1-64b78ff78b25 nodeName:}" failed. No retries permitted until 2026-06-09 02:25:53.081598019 +0000 UTC m=+252.243968242 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs") pod "network-metrics-daemon-qvf66" (UID: "53c8ff5a-405e-44f9-88a1-64b78ff78b25") : secret "metrics-daemon-secret" not found Jun 09 02:24:17.712111 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:17.712075 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" Jun 09 02:24:17.772503 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:17.772478 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gxpgm" podUID="c851bf2f-3504-4317-af6c-165888f67ebc" Jun 09 02:24:17.943167 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:17.943138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:24:19.340149 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:19.340110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qvf66" podUID="53c8ff5a-405e-44f9-88a1-64b78ff78b25" Jun 09 02:24:22.594657 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:22.594556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:24:22.595085 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:22.594675 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 02:24:22.595085 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:22.594687 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565889c4f5-hwzr2: secret "image-registry-tls" not found Jun 09 02:24:22.595085 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:22.594748 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls podName:e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8 nodeName:}" failed. No retries permitted until 2026-06-09 02:26:24.5947331 +0000 UTC m=+283.757103322 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls") pod "image-registry-565889c4f5-hwzr2" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8") : secret "image-registry-tls" not found Jun 09 02:24:22.695605 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:22.695574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:24:22.695752 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:22.695677 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 02:24:22.695752 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:24:22.695732 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls podName:c851bf2f-3504-4317-af6c-165888f67ebc nodeName:}" failed. No retries permitted until 2026-06-09 02:26:24.69572035 +0000 UTC m=+283.858090573 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls") pod "dns-default-gxpgm" (UID: "c851bf2f-3504-4317-af6c-165888f67ebc") : secret "dns-default-metrics-tls" not found Jun 09 02:24:25.587063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.587007 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" podUID="acfa0726-ae9e-4d23-8f69-900462743141" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jun 09 02:24:25.968634 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.968600 2577 generic.go:356] "Generic (PLEG): container finished" podID="7588b13e-6583-450c-888c-9af0cb65cc60" containerID="629c755914aa021a881a7d15c5b0c68375940cf8ac6488115d140c2a4f8c9f14" exitCode=255 Jun 09 02:24:25.968824 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.968668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerDied","Data":"629c755914aa021a881a7d15c5b0c68375940cf8ac6488115d140c2a4f8c9f14"} Jun 09 02:24:25.969037 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.969020 2577 scope.go:117] "RemoveContainer" containerID="629c755914aa021a881a7d15c5b0c68375940cf8ac6488115d140c2a4f8c9f14" Jun 09 02:24:25.970119 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.970091 2577 generic.go:356] "Generic (PLEG): container finished" podID="acfa0726-ae9e-4d23-8f69-900462743141" containerID="b9252780b1b4d21801f75ea42060cbca9601098dbdf7418bcb6392e77f20035c" exitCode=1 Jun 09 02:24:25.970202 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.970128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerDied","Data":"b9252780b1b4d21801f75ea42060cbca9601098dbdf7418bcb6392e77f20035c"} Jun 09 02:24:25.970398 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:25.970384 2577 scope.go:117] "RemoveContainer" containerID="b9252780b1b4d21801f75ea42060cbca9601098dbdf7418bcb6392e77f20035c" Jun 09 02:24:26.974188 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:26.974149 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerStarted","Data":"8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b"} Jun 09 02:24:26.975682 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:26.975658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerStarted","Data":"1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f"} Jun 09 02:24:26.975907 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:26.975889 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:24:26.976465 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:26.976447 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:24:32.302699 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:32.302661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxpgm" Jun 09 02:24:33.302764 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:24:33.302729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:25:05.186157 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:05.186122 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmvnh_f354c442-b9c3-49db-b1ee-c72040a0f38c/dns-node-resolver/0.log" Jun 09 02:25:06.187104 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:06.187075 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktspj_ef30b5e5-ab28-4ed4-98de-e3bf134130d1/node-ca/0.log" Jun 09 02:25:06.789162 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:06.789131 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5x42p_6d58419f-147f-4c7f-a92f-14abf07f6b6a/serve-healthcheck-canary/0.log" Jun 09 02:25:25.032755 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.032716 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" podUID="94d241d1-fd09-42c9-9219-ae11a13be160" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:25:25.068784 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.068743 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xx6mr"] Jun 09 02:25:25.071629 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.071609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.074197 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.074177 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 02:25:25.074356 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.074180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 02:25:25.075182 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.075162 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfg7w\"" Jun 09 02:25:25.075381 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.075367 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 02:25:25.075434 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.075406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 02:25:25.081423 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.081404 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xx6mr"] Jun 09 02:25:25.218979 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.218947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.219083 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.218981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc88c0ef-5372-40ad-9f0d-4578321f754b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.219083 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.219005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7q2\" (UniqueName: \"kubernetes.io/projected/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-api-access-xc7q2\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.219083 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.219074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc88c0ef-5372-40ad-9f0d-4578321f754b-crio-socket\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.219207 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.219096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc88c0ef-5372-40ad-9f0d-4578321f754b-data-volume\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320082 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc88c0ef-5372-40ad-9f0d-4578321f754b-crio-socket\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320082 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc88c0ef-5372-40ad-9f0d-4578321f754b-data-volume\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320229 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320229 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc88c0ef-5372-40ad-9f0d-4578321f754b-crio-socket\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320229 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc88c0ef-5372-40ad-9f0d-4578321f754b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320229 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7q2\" (UniqueName: \"kubernetes.io/projected/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-api-access-xc7q2\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320519 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc88c0ef-5372-40ad-9f0d-4578321f754b-data-volume\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.320734 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.320716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.322518 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.322499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc88c0ef-5372-40ad-9f0d-4578321f754b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.327833 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.327809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7q2\" (UniqueName: \"kubernetes.io/projected/bc88c0ef-5372-40ad-9f0d-4578321f754b-kube-api-access-xc7q2\") pod \"insights-runtime-extractor-xx6mr\" (UID: \"bc88c0ef-5372-40ad-9f0d-4578321f754b\") " pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.380823 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.380801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xx6mr" Jun 09 02:25:25.497982 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:25.497955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xx6mr"] Jun 09 02:25:25.501898 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:25:25.501872 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc88c0ef_5372_40ad_9f0d_4578321f754b.slice/crio-1cca02aa567fbf1457d09361cdd700207548502ede8b98bfa2323e690917c1c3 WatchSource:0}: Error finding container 1cca02aa567fbf1457d09361cdd700207548502ede8b98bfa2323e690917c1c3: Status 404 returned error can't find the container with id 1cca02aa567fbf1457d09361cdd700207548502ede8b98bfa2323e690917c1c3 Jun 09 02:25:26.171464 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:26.171436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xx6mr" event={"ID":"bc88c0ef-5372-40ad-9f0d-4578321f754b","Type":"ContainerStarted","Data":"f561003ea73bffcee514f42b7dcd587e20b6599c562da8eaf6db418d2c39cdc4"} Jun 09 02:25:26.171821 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:26.171487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xx6mr" event={"ID":"bc88c0ef-5372-40ad-9f0d-4578321f754b","Type":"ContainerStarted","Data":"1cca02aa567fbf1457d09361cdd700207548502ede8b98bfa2323e690917c1c3"} Jun 09 02:25:27.176577 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:27.176540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xx6mr" event={"ID":"bc88c0ef-5372-40ad-9f0d-4578321f754b","Type":"ContainerStarted","Data":"3c1f16dc4ca3c422befe482dd12d2f2e6f6725ac5d753bcd2e7ba1a1babc03a2"} Jun 09 02:25:28.183696 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:28.183659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xx6mr" event={"ID":"bc88c0ef-5372-40ad-9f0d-4578321f754b","Type":"ContainerStarted","Data":"ac4ae17025836848617bf066b948214074b050b10642f80f8a3ed2aed955afd9"} Jun 09 02:25:28.200579 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:28.200528 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xx6mr" podStartSLOduration=1.045428216 podStartE2EDuration="3.200513541s" totalImagesPullingTime="2.155085325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:25:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:28.199495469 +0000 UTC m=+227.361865742" watchObservedRunningTime="2026-06-09 02:25:28.200513541 +0000 UTC m=+227.362883785" Jun 09 02:25:35.032866 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:35.032823 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" podUID="94d241d1-fd09-42c9-9219-ae11a13be160" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:25:41.134399 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.134370 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mtx9f"] Jun 09 02:25:41.142299 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.142274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.145261 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.145238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 02:25:41.145373 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.145263 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 02:25:41.145890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.145870 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 02:25:41.146081 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.146064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 02:25:41.146160 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.146093 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 02:25:41.146790 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.146763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tj8kd\"" Jun 09 02:25:41.146873 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.146807 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 02:25:41.230003 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.229980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-wtmp\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230097 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-sys\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230097 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230097 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-root\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230205 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-textfile\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230205 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5j4\" (UniqueName: \"kubernetes.io/projected/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-kube-api-access-5b5j4\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230274 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230274 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-metrics-client-ca\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.230274 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.230255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-tls\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.330965 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.330925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-textfile\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.330977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5j4\" (UniqueName: \"kubernetes.io/projected/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-kube-api-access-5b5j4\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-metrics-client-ca\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-tls\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-wtmp\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-sys\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-root\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-sys\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331281 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-textfile\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331483 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-wtmp\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.331483 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.331306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-root\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.333979 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.333959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 02:25:41.334133 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.334111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 02:25:41.334532 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.334510 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 02:25:41.335089 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.335070 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 02:25:41.341104 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.341079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 02:25:41.341610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.341580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-metrics-client-ca\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.341808 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.341789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.343531 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.343512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-tls\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.343629 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.343589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.350108 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.350090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 02:25:41.360244 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.360221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5j4\" (UniqueName: \"kubernetes.io/projected/4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1-kube-api-access-5b5j4\") pod \"node-exporter-mtx9f\" (UID: \"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1\") " pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.453093 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.453046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tj8kd\"" Jun 09 02:25:41.461835 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:41.461821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtx9f" Jun 09 02:25:41.473127 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:25:41.473105 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4d7aa8_8a06_4a57_a7b5_47315f92cfd1.slice/crio-cf8cddbb920baf242f5399ab3713e6edb8fe0c2fd20289e4a7d4daae515b89cd WatchSource:0}: Error finding container cf8cddbb920baf242f5399ab3713e6edb8fe0c2fd20289e4a7d4daae515b89cd: Status 404 returned error can't find the container with id cf8cddbb920baf242f5399ab3713e6edb8fe0c2fd20289e4a7d4daae515b89cd Jun 09 02:25:42.228199 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:42.228121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtx9f" event={"ID":"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1","Type":"ContainerStarted","Data":"cf8cddbb920baf242f5399ab3713e6edb8fe0c2fd20289e4a7d4daae515b89cd"} Jun 09 02:25:43.232520 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:43.232490 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1" containerID="089dccfe4e348720117164c4514c8d9d41bd2230e48a805c7e5f29a492ed47e1" exitCode=0 Jun 09 02:25:43.232911 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:43.232539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtx9f" event={"ID":"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1","Type":"ContainerDied","Data":"089dccfe4e348720117164c4514c8d9d41bd2230e48a805c7e5f29a492ed47e1"} Jun 09 02:25:44.238561 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:44.238521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtx9f" event={"ID":"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1","Type":"ContainerStarted","Data":"7678444bba0e66af10b0a4a09b828190e22efb7ce5f54f565cf6a0e4c0b709b9"} Jun 09 02:25:44.239081 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:44.238578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtx9f" event={"ID":"4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1","Type":"ContainerStarted","Data":"d24d187132aff3ecddd60b81fa8876a56529c007e855abc01b35e30dc82f8e7c"} Jun 09 02:25:44.256676 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:44.256624 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mtx9f" podStartSLOduration=2.326256013 podStartE2EDuration="3.256607687s" totalImagesPullingTime="868.89334ms" totalInitContainerRuntime="61.458334ms" isStatefulPod=true podCreationTimestamp="2026-06-09 02:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:44.254806835 +0000 UTC m=+243.417177076" watchObservedRunningTime="2026-06-09 02:25:44.256607687 +0000 UTC m=+243.418977931" Jun 09 02:25:45.032787 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.032731 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" podUID="94d241d1-fd09-42c9-9219-ae11a13be160" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 02:25:45.032991 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.032820 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" Jun 09 02:25:45.033323 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.033274 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"99ed43f1b51bc2314b37c20fb4b18fd8134c9b72fd8ebdfcf6e809b2d26de416"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 02:25:45.033407 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.033345 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" podUID="94d241d1-fd09-42c9-9219-ae11a13be160" containerName="service-proxy" containerID="cri-o://99ed43f1b51bc2314b37c20fb4b18fd8134c9b72fd8ebdfcf6e809b2d26de416" gracePeriod=30 Jun 09 02:25:45.247519 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.247490 2577 generic.go:356] "Generic (PLEG): container finished" podID="94d241d1-fd09-42c9-9219-ae11a13be160" containerID="99ed43f1b51bc2314b37c20fb4b18fd8134c9b72fd8ebdfcf6e809b2d26de416" exitCode=2 Jun 09 02:25:45.247830 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.247558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerDied","Data":"99ed43f1b51bc2314b37c20fb4b18fd8134c9b72fd8ebdfcf6e809b2d26de416"} Jun 09 02:25:45.247830 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:45.247603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85c46b6fff-l5qfd" event={"ID":"94d241d1-fd09-42c9-9219-ae11a13be160","Type":"ContainerStarted","Data":"12f1aa0673bb7f8f185e55b6a3f97d1325ac7fcdf106af507c331c454f6d3c61"} Jun 09 02:25:53.115260 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:53.115170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:25:53.117563 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:53.117540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53c8ff5a-405e-44f9-88a1-64b78ff78b25-metrics-certs\") pod \"network-metrics-daemon-qvf66\" (UID: \"53c8ff5a-405e-44f9-88a1-64b78ff78b25\") " pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:25:53.405992 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:53.405918 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqw9m\"" Jun 09 02:25:53.414816 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:53.414791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qvf66" Jun 09 02:25:53.541838 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:53.541812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qvf66"] Jun 09 02:25:53.544830 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:25:53.544802 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c8ff5a_405e_44f9_88a1_64b78ff78b25.slice/crio-456b4ed6b5a756a7a743e8f3b5a1ebb83da6e48b3d516b1394d55988e7122baf WatchSource:0}: Error finding container 456b4ed6b5a756a7a743e8f3b5a1ebb83da6e48b3d516b1394d55988e7122baf: Status 404 returned error can't find the container with id 456b4ed6b5a756a7a743e8f3b5a1ebb83da6e48b3d516b1394d55988e7122baf Jun 09 02:25:54.277992 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:54.277953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvf66" event={"ID":"53c8ff5a-405e-44f9-88a1-64b78ff78b25","Type":"ContainerStarted","Data":"456b4ed6b5a756a7a743e8f3b5a1ebb83da6e48b3d516b1394d55988e7122baf"} Jun 09 02:25:55.283709 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:55.283671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvf66" event={"ID":"53c8ff5a-405e-44f9-88a1-64b78ff78b25","Type":"ContainerStarted","Data":"efc927ea9d971b974dc2a2d08190664aee7d850fdeccfa6c1e32e5b0b853c4e1"} Jun 09 02:25:55.284210 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:55.283736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qvf66" event={"ID":"53c8ff5a-405e-44f9-88a1-64b78ff78b25","Type":"ContainerStarted","Data":"f9a9f94801909e63e4fb26fe4a70d1f145bd0e63f8de9485c1a140a7c183341f"} Jun 09 02:25:55.301973 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:25:55.301924 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qvf66" podStartSLOduration=253.298676888 podStartE2EDuration="4m14.301906567s" totalImagesPullingTime="1.003229679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:25:55.300910871 +0000 UTC m=+254.463281116" watchObservedRunningTime="2026-06-09 02:25:55.301906567 +0000 UTC m=+254.464276811" Jun 09 02:26:19.518256 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:19.518226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/init-textfile/0.log" Jun 09 02:26:19.720085 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:19.720058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/node-exporter/0.log" Jun 09 02:26:19.918644 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:19.918614 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/kube-rbac-proxy/0.log" Jun 09 02:26:20.944238 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:20.944203 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" Jun 09 02:26:21.366317 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:21.366289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:24.618824 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.618788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:24.621380 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.621356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"image-registry-565889c4f5-hwzr2\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:24.669449 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.669424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8sdz2\"" Jun 09 02:26:24.678122 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.678108 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:24.719543 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.719511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:26:24.721859 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.721833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c851bf2f-3504-4317-af6c-165888f67ebc-metrics-tls\") pod \"dns-default-gxpgm\" (UID: \"c851bf2f-3504-4317-af6c-165888f67ebc\") " pod="openshift-dns/dns-default-gxpgm" Jun 09 02:26:24.802849 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.802824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:26:24.805184 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:26:24.805158 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49dafd4_8f5a_46c5_a0b6_a0631fc77ab8.slice/crio-fcf5a6dc6c1d44123f607c26d4e1a2407cf76ee69a60b400be9e913eadd671d7 WatchSource:0}: Error finding container fcf5a6dc6c1d44123f607c26d4e1a2407cf76ee69a60b400be9e913eadd671d7: Status 404 returned error can't find the container with id fcf5a6dc6c1d44123f607c26d4e1a2407cf76ee69a60b400be9e913eadd671d7 Jun 09 02:26:24.805992 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.805972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rpcr5\"" Jun 09 02:26:24.814381 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.814364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gxpgm" Jun 09 02:26:24.937876 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:24.937810 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gxpgm"] Jun 09 02:26:24.940264 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:26:24.940238 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc851bf2f_3504_4317_af6c_165888f67ebc.slice/crio-6313eb6a3fafe56af7d0b1d59b25eec1112c730bc4b11b7d6e6d206a8d8a82b3 WatchSource:0}: Error finding container 6313eb6a3fafe56af7d0b1d59b25eec1112c730bc4b11b7d6e6d206a8d8a82b3: Status 404 returned error can't find the container with id 6313eb6a3fafe56af7d0b1d59b25eec1112c730bc4b11b7d6e6d206a8d8a82b3 Jun 09 02:26:25.380671 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:25.380639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" event={"ID":"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8","Type":"ContainerStarted","Data":"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664"} Jun 09 02:26:25.380889 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:25.380693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" event={"ID":"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8","Type":"ContainerStarted","Data":"fcf5a6dc6c1d44123f607c26d4e1a2407cf76ee69a60b400be9e913eadd671d7"} Jun 09 02:26:25.380982 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:25.380914 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:25.382167 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:25.382104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxpgm" event={"ID":"c851bf2f-3504-4317-af6c-165888f67ebc","Type":"ContainerStarted","Data":"6313eb6a3fafe56af7d0b1d59b25eec1112c730bc4b11b7d6e6d206a8d8a82b3"} Jun 09 02:26:25.400752 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:25.400701 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" podStartSLOduration=284.400683217 podStartE2EDuration="4m44.400683217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:25.398354926 +0000 UTC m=+284.560725172" watchObservedRunningTime="2026-06-09 02:26:25.400683217 +0000 UTC m=+284.563053462" Jun 09 02:26:26.389301 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.389214 2577 generic.go:356] "Generic (PLEG): container finished" podID="acfa0726-ae9e-4d23-8f69-900462743141" containerID="1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f" exitCode=1 Jun 09 02:26:26.389710 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.389328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerDied","Data":"1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f"} Jun 09 02:26:26.389710 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.389394 2577 scope.go:117] "RemoveContainer" containerID="b9252780b1b4d21801f75ea42060cbca9601098dbdf7418bcb6392e77f20035c" Jun 09 02:26:26.389857 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.389838 2577 scope.go:117] "RemoveContainer" containerID="1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f" Jun 09 02:26:26.390065 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:26.390036 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-856d6c8bc6-mvz8j_open-cluster-management-agent-addon(acfa0726-ae9e-4d23-8f69-900462743141)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" podUID="acfa0726-ae9e-4d23-8f69-900462743141" Jun 09 02:26:26.391958 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.391936 2577 generic.go:356] "Generic (PLEG): container finished" podID="7588b13e-6583-450c-888c-9af0cb65cc60" containerID="8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b" exitCode=255 Jun 09 02:26:26.392067 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.391968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerDied","Data":"8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b"} Jun 09 02:26:26.392466 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.392440 2577 scope.go:117] "RemoveContainer" containerID="8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b" Jun 09 02:26:26.392602 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:26.392582 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59b6444cb8-l78h6_open-cluster-management-agent-addon(7588b13e-6583-450c-888c-9af0cb65cc60)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" podUID="7588b13e-6583-450c-888c-9af0cb65cc60" Jun 09 02:26:26.571890 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.571860 2577 scope.go:117] "RemoveContainer" containerID="629c755914aa021a881a7d15c5b0c68375940cf8ac6488115d140c2a4f8c9f14" Jun 09 02:26:26.919095 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.919027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmvnh_f354c442-b9c3-49db-b1ee-c72040a0f38c/dns-node-resolver/0.log" Jun 09 02:26:26.976438 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:26.976401 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:26:27.119548 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.119515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-565889c4f5-hwzr2_e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8/registry/0.log" Jun 09 02:26:27.396589 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.396565 2577 scope.go:117] "RemoveContainer" containerID="1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f" Jun 09 02:26:27.397017 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:27.396743 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-856d6c8bc6-mvz8j_open-cluster-management-agent-addon(acfa0726-ae9e-4d23-8f69-900462743141)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" podUID="acfa0726-ae9e-4d23-8f69-900462743141" Jun 09 02:26:27.398207 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.398171 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxpgm" event={"ID":"c851bf2f-3504-4317-af6c-165888f67ebc","Type":"ContainerStarted","Data":"f4f7fbccce87e8d2bb8a03450d1f3a2125121f7030e3d99e549e169877d7c278"} Jun 09 02:26:27.398340 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.398232 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gxpgm" Jun 09 02:26:27.398340 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.398259 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gxpgm" event={"ID":"c851bf2f-3504-4317-af6c-165888f67ebc","Type":"ContainerStarted","Data":"913331ba15112e9201fc7b884b5911be6be29d9e51d01c6cbe418c70698f3b8e"} Jun 09 02:26:27.428921 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.428877 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gxpgm" podStartSLOduration=251.759140141 podStartE2EDuration="4m13.428864342s" totalImagesPullingTime="1.669724201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:26:27.42808814 +0000 UTC m=+286.590458384" watchObservedRunningTime="2026-06-09 02:26:27.428864342 +0000 UTC m=+286.591234638" Jun 09 02:26:27.919717 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:27.919685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktspj_ef30b5e5-ab28-4ed4-98de-e3bf134130d1/node-ca/0.log" Jun 09 02:26:28.518480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:28.518445 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5x42p_6d58419f-147f-4c7f-a92f-14abf07f6b6a/serve-healthcheck-canary/0.log" Jun 09 02:26:34.985293 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:34.985254 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" Jun 09 02:26:34.985735 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:34.985583 2577 scope.go:117] "RemoveContainer" containerID="8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b" Jun 09 02:26:34.985735 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:34.985711 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59b6444cb8-l78h6_open-cluster-management-agent-addon(7588b13e-6583-450c-888c-9af0cb65cc60)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" podUID="7588b13e-6583-450c-888c-9af0cb65cc60" Jun 09 02:26:34.994876 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:34.994856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:26:34.995161 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:34.995148 2577 scope.go:117] "RemoveContainer" containerID="1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f" Jun 09 02:26:34.995287 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:26:34.995270 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-856d6c8bc6-mvz8j_open-cluster-management-agent-addon(acfa0726-ae9e-4d23-8f69-900462743141)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" podUID="acfa0726-ae9e-4d23-8f69-900462743141" Jun 09 02:26:37.406256 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:37.406220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gxpgm" Jun 09 02:26:41.252866 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:41.252838 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:26:41.254813 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:41.254784 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:26:41.255736 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:41.255716 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 02:26:44.683414 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:44.683366 2577 patch_prober.go:28] interesting pod/image-registry-565889c4f5-hwzr2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 02:26:44.684956 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:44.683423 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:26:46.396967 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:46.396935 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:26:48.303558 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:48.303530 2577 scope.go:117] "RemoveContainer" containerID="8ebe1a553c4a6fbc39e844a368de407ddc674d9cae16a2b41f34511d09d0c33b" Jun 09 02:26:48.472160 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:48.472126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59b6444cb8-l78h6" event={"ID":"7588b13e-6583-450c-888c-9af0cb65cc60","Type":"ContainerStarted","Data":"a0acccdc80ac10ae892a0cb9def16ae51afdc381811433c421260e436fa42c6e"} Jun 09 02:26:49.303080 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:49.303048 2577 scope.go:117] "RemoveContainer" containerID="1410b50cba7dd266eb8eae5b642055bbe5d9fd05e58de070723e7818dad0787f" Jun 09 02:26:49.477238 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:49.477204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" event={"ID":"acfa0726-ae9e-4d23-8f69-900462743141","Type":"ContainerStarted","Data":"8f6ea1714f5e6b51a3947a0e78917c4205f6f605d18cf33549f7fb9e9de890cb"} Jun 09 02:26:49.477671 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:49.477515 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:26:49.479070 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:49.479050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856d6c8bc6-mvz8j" Jun 09 02:26:53.547306 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:26:53.547271 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:27:18.566528 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:18.566472 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerName="registry" containerID="cri-o://7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664" gracePeriod=30 Jun 09 02:27:19.801396 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.801375 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:27:19.891126 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891092 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891220 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891135 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891220 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891173 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk5jr\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891220 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891359 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891359 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891289 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891359 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891311 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891359 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891339 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token\") pod \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\" (UID: \"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8\") " Jun 09 02:27:19.891611 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891588 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:27:19.891707 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.891674 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 02:27:19.893736 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.893692 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:27:19.893847 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.893736 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:27:19.893847 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.893751 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:27:19.893847 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.893830 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:27:19.893953 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.893870 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr" (OuterVolumeSpecName: "kube-api-access-lk5jr") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "kube-api-access-lk5jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:27:19.899778 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.899714 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" (UID: "e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 02:27:19.992507 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992489 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-trusted-ca\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992507 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992507 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-ca-trust-extracted\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992517 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk5jr\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-kube-api-access-lk5jr\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992526 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-certificates\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992535 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-image-registry-private-configuration\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992545 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-installation-pull-secrets\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992553 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-registry-tls\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:19.992616 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:19.992561 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8-bound-sa-token\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:27:20.579280 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.579214 2577 generic.go:356] "Generic (PLEG): container finished" podID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerID="7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664" exitCode=0 Jun 09 02:27:20.579280 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.579259 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" Jun 09 02:27:20.579480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.579303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" event={"ID":"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8","Type":"ContainerDied","Data":"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664"} Jun 09 02:27:20.579480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.579360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565889c4f5-hwzr2" event={"ID":"e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8","Type":"ContainerDied","Data":"fcf5a6dc6c1d44123f607c26d4e1a2407cf76ee69a60b400be9e913eadd671d7"} Jun 09 02:27:20.579480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.579387 2577 scope.go:117] "RemoveContainer" containerID="7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664" Jun 09 02:27:20.587357 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.587340 2577 scope.go:117] "RemoveContainer" containerID="7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664" Jun 09 02:27:20.587592 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:27:20.587573 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664\": container with ID starting with 7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664 not found: ID does not exist" containerID="7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664" Jun 09 02:27:20.587638 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.587600 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664"} err="failed to get container status \"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664\": rpc error: code = NotFound desc = could not find container \"7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664\": container with ID starting with 7d2069704c974c263ff76c3d3397edf2fb94b95ad7f31f23b5701e86ad59a664 not found: ID does not exist" Jun 09 02:27:20.599208 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.599186 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:27:20.602400 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:20.602381 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-565889c4f5-hwzr2"] Jun 09 02:27:21.307039 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:27:21.307011 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" path="/var/lib/kubelet/pods/e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8/volumes" Jun 09 02:29:36.214511 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.214472 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr"] Jun 09 02:29:36.215020 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.214805 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerName="registry" Jun 09 02:29:36.215020 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.214822 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerName="registry" Jun 09 02:29:36.215020 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.214878 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49dafd4-8f5a-46c5-a0b6-a0631fc77ab8" containerName="registry" Jun 09 02:29:36.216589 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.216574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.219264 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.219242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7nlm4\"" Jun 09 02:29:36.219386 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.219249 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 02:29:36.219386 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.219295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 02:29:36.225963 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.225942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr"] Jun 09 02:29:36.264160 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.264133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g79gf\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-kube-api-access-g79gf\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.264259 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.264172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.364651 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.364628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.364740 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.364675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g79gf\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-kube-api-access-g79gf\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.372388 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.372364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g79gf\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-kube-api-access-g79gf\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.372475 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.372408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e05f7776-5839-48fd-8e8f-a812d515f67c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-qsjbr\" (UID: \"e05f7776-5839-48fd-8e8f-a812d515f67c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.525033 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.524975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" Jun 09 02:29:36.647589 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.647560 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr"] Jun 09 02:29:36.650672 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:29:36.650647 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode05f7776_5839_48fd_8e8f_a812d515f67c.slice/crio-e815b50c35de9ade295ba2a866c6e1fac43108198c676a0a3d63ccb1804d7f19 WatchSource:0}: Error finding container e815b50c35de9ade295ba2a866c6e1fac43108198c676a0a3d63ccb1804d7f19: Status 404 returned error can't find the container with id e815b50c35de9ade295ba2a866c6e1fac43108198c676a0a3d63ccb1804d7f19 Jun 09 02:29:36.652691 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:36.652675 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:29:37.033983 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:37.033949 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" event={"ID":"e05f7776-5839-48fd-8e8f-a812d515f67c","Type":"ContainerStarted","Data":"e815b50c35de9ade295ba2a866c6e1fac43108198c676a0a3d63ccb1804d7f19"} Jun 09 02:29:41.050555 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:41.050515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" event={"ID":"e05f7776-5839-48fd-8e8f-a812d515f67c","Type":"ContainerStarted","Data":"c8a679717fa3afbc5d8361ae3637a11fad673581cbb7283987d83a4d008c627d"} Jun 09 02:29:41.065385 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:41.065343 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-qsjbr" podStartSLOduration=1.7280105080000001 podStartE2EDuration="5.065327564s" totalImagesPullingTime="3.337317056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:41.064053146 +0000 UTC m=+480.226423391" watchObservedRunningTime="2026-06-09 02:29:41.065327564 +0000 UTC m=+480.227697809" Jun 09 02:29:53.235300 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.235261 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-897kr"] Jun 09 02:29:53.237496 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.237470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.239671 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.239641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jftzr\"" Jun 09 02:29:53.245508 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.245482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-897kr"] Jun 09 02:29:53.277353 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.277324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-bound-sa-token\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.277445 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.277356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpqbv\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-kube-api-access-bpqbv\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.378196 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.378168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-bound-sa-token\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.378283 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.378200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpqbv\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-kube-api-access-bpqbv\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.386383 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.386356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-bound-sa-token\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.386383 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.386386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpqbv\" (UniqueName: \"kubernetes.io/projected/8daace59-40fe-4ec9-9119-bd4440affac8-kube-api-access-bpqbv\") pod \"cert-manager-59c77684cc-897kr\" (UID: \"8daace59-40fe-4ec9-9119-bd4440affac8\") " pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.547011 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.546989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-897kr" Jun 09 02:29:53.668873 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:53.668844 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-897kr"] Jun 09 02:29:53.672019 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:29:53.671993 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8daace59_40fe_4ec9_9119_bd4440affac8.slice/crio-775f247d93a6ecee57b722b1cb291e06303fdca9668af202f2699e605447fd13 WatchSource:0}: Error finding container 775f247d93a6ecee57b722b1cb291e06303fdca9668af202f2699e605447fd13: Status 404 returned error can't find the container with id 775f247d93a6ecee57b722b1cb291e06303fdca9668af202f2699e605447fd13 Jun 09 02:29:54.095735 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:54.095705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-897kr" event={"ID":"8daace59-40fe-4ec9-9119-bd4440affac8","Type":"ContainerStarted","Data":"63cd7b0b73a0c34b868e3eb1809115b8468da15b7bd846b416ab6f7353ec5573"} Jun 09 02:29:54.095904 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:54.095746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-897kr" event={"ID":"8daace59-40fe-4ec9-9119-bd4440affac8","Type":"ContainerStarted","Data":"775f247d93a6ecee57b722b1cb291e06303fdca9668af202f2699e605447fd13"} Jun 09 02:29:54.110246 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:29:54.110203 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-897kr" podStartSLOduration=1.110189015 podStartE2EDuration="1.110189015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:29:54.10916607 +0000 UTC m=+493.271536313" watchObservedRunningTime="2026-06-09 02:29:54.110189015 +0000 UTC m=+493.272559259" Jun 09 02:30:05.519321 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.519291 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl"] Jun 09 02:30:05.522714 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.522140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.526925 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.526886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mw8s5\"" Jun 09 02:30:05.527066 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.526943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 02:30:05.527066 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.526953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 02:30:05.527177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.527119 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 02:30:05.527894 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.527879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 02:30:05.535306 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.535284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl"] Jun 09 02:30:05.661330 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.661309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfnhk\" (UniqueName: \"kubernetes.io/projected/aae96921-1270-4e02-a69d-a28b7ae4397d-kube-api-access-dfnhk\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.661451 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.661337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-manifests\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.661451 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.661357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-tmp\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.661451 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.661389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.661555 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.661452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762343 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-tmp\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfnhk\" (UniqueName: \"kubernetes.io/projected/aae96921-1270-4e02-a69d-a28b7ae4397d-kube-api-access-dfnhk\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762599 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-manifests\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.762879 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.762850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-manifests\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.764764 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.764742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aae96921-1270-4e02-a69d-a28b7ae4397d-tmp\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.764863 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.764829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.765013 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.764991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aae96921-1270-4e02-a69d-a28b7ae4397d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.772495 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.772439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfnhk\" (UniqueName: \"kubernetes.io/projected/aae96921-1270-4e02-a69d-a28b7ae4397d-kube-api-access-dfnhk\") pod \"opendatahub-operator-controller-manager-64f4c8f55c-7kvzl\" (UID: \"aae96921-1270-4e02-a69d-a28b7ae4397d\") " pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.834331 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.834310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:05.963935 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:05.963903 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl"] Jun 09 02:30:05.967128 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:30:05.967101 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae96921_1270_4e02_a69d_a28b7ae4397d.slice/crio-f87476d8381a7a85c8143cf3ff5fcb8e29fa742c3a0f9326d246a5f0d3006b71 WatchSource:0}: Error finding container f87476d8381a7a85c8143cf3ff5fcb8e29fa742c3a0f9326d246a5f0d3006b71: Status 404 returned error can't find the container with id f87476d8381a7a85c8143cf3ff5fcb8e29fa742c3a0f9326d246a5f0d3006b71 Jun 09 02:30:06.137443 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:06.137414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" event={"ID":"aae96921-1270-4e02-a69d-a28b7ae4397d","Type":"ContainerStarted","Data":"f87476d8381a7a85c8143cf3ff5fcb8e29fa742c3a0f9326d246a5f0d3006b71"} Jun 09 02:30:09.150542 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:09.150512 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" event={"ID":"aae96921-1270-4e02-a69d-a28b7ae4397d","Type":"ContainerStarted","Data":"05dff643a51645b29ce38eb5fd6bf76eab33c3989e05bfda8a8f979b994c930f"} Jun 09 02:30:10.155608 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:10.155569 2577 generic.go:356] "Generic (PLEG): container finished" podID="aae96921-1270-4e02-a69d-a28b7ae4397d" containerID="05dff643a51645b29ce38eb5fd6bf76eab33c3989e05bfda8a8f979b994c930f" exitCode=0 Jun 09 02:30:10.156027 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:10.155653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" event={"ID":"aae96921-1270-4e02-a69d-a28b7ae4397d","Type":"ContainerDied","Data":"05dff643a51645b29ce38eb5fd6bf76eab33c3989e05bfda8a8f979b994c930f"} Jun 09 02:30:11.161148 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:11.161106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" event={"ID":"aae96921-1270-4e02-a69d-a28b7ae4397d","Type":"ContainerStarted","Data":"6f29a38b8d4d4305fe535bb867af3a178fd14be48b6da3c20da2a21c8e2e6abf"} Jun 09 02:30:11.161592 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:11.161234 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:11.185731 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:11.185622 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" podStartSLOduration=2.202549216 podStartE2EDuration="6.185604046s" totalImagesPullingTime="3.073931739s" totalInitContainerRuntime="909.123091ms" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:11.184391135 +0000 UTC m=+510.346761378" watchObservedRunningTime="2026-06-09 02:30:11.185604046 +0000 UTC m=+510.347974290" Jun 09 02:30:22.168157 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:22.168078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64f4c8f55c-7kvzl" Jun 09 02:30:25.860066 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.860030 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c"] Jun 09 02:30:25.864059 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.864038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867347 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867367 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867404 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867464 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 02:30:25.867534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.867513 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wql78\"" Jun 09 02:30:25.885474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:25.885449 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c"] Jun 09 02:30:26.010889 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.010854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.011072 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.010892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8x9\" (UniqueName: \"kubernetes.io/projected/0e368ed1-237c-4702-a592-4ba232c0766d-kube-api-access-jn8x9\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.011072 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.010934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-metrics-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.011072 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.011009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e368ed1-237c-4702-a592-4ba232c0766d-manager-config\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.111718 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.111634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e368ed1-237c-4702-a592-4ba232c0766d-manager-config\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.111718 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.111679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.111718 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.111698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8x9\" (UniqueName: \"kubernetes.io/projected/0e368ed1-237c-4702-a592-4ba232c0766d-kube-api-access-jn8x9\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.111939 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.111748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-metrics-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.112291 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.112273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e368ed1-237c-4702-a592-4ba232c0766d-manager-config\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.114233 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.114209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.114340 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.114252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e368ed1-237c-4702-a592-4ba232c0766d-metrics-cert\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.119060 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.119042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8x9\" (UniqueName: \"kubernetes.io/projected/0e368ed1-237c-4702-a592-4ba232c0766d-kube-api-access-jn8x9\") pod \"lws-controller-manager-d95874d7-8bv8c\" (UID: \"0e368ed1-237c-4702-a592-4ba232c0766d\") " pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.173941 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.173913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:26.305476 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:26.305450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c"] Jun 09 02:30:26.308174 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:30:26.308140 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e368ed1_237c_4702_a592_4ba232c0766d.slice/crio-485224a4bd8cd9c65ff3e2b856f872c7db0a6ccffa08b4425f958c6aead484de WatchSource:0}: Error finding container 485224a4bd8cd9c65ff3e2b856f872c7db0a6ccffa08b4425f958c6aead484de: Status 404 returned error can't find the container with id 485224a4bd8cd9c65ff3e2b856f872c7db0a6ccffa08b4425f958c6aead484de Jun 09 02:30:27.218742 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:27.218710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" event={"ID":"0e368ed1-237c-4702-a592-4ba232c0766d","Type":"ContainerStarted","Data":"485224a4bd8cd9c65ff3e2b856f872c7db0a6ccffa08b4425f958c6aead484de"} Jun 09 02:30:30.233560 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:30.233479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" event={"ID":"0e368ed1-237c-4702-a592-4ba232c0766d","Type":"ContainerStarted","Data":"d4034aafcde4cdea2acd2267ea18898e5a28d2a9cbddc9ef7938e7e8527ca100"} Jun 09 02:30:30.234013 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:30.233605 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:30.249650 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:30.249597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" podStartSLOduration=1.772333052 podStartE2EDuration="5.249580389s" totalImagesPullingTime="3.477247337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:30.248441351 +0000 UTC m=+529.410811610" watchObservedRunningTime="2026-06-09 02:30:30.249580389 +0000 UTC m=+529.411950632" Jun 09 02:30:41.239184 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:41.239157 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d95874d7-8bv8c" Jun 09 02:30:54.854149 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.854113 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6b97469585-kzlmv"] Jun 09 02:30:54.857131 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.857111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:54.859506 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.859481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4hb8n\"" Jun 09 02:30:54.859630 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.859486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 02:30:54.863832 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.863809 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b97469585-kzlmv"] Jun 09 02:30:54.911403 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.911379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/44981372-5df2-487e-b23d-733275062959-redirect-config\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:54.911489 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:54.911460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqcd\" (UniqueName: \"kubernetes.io/projected/44981372-5df2-487e-b23d-733275062959-kube-api-access-bhqcd\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.012753 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.012733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/44981372-5df2-487e-b23d-733275062959-redirect-config\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.012858 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.012818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqcd\" (UniqueName: \"kubernetes.io/projected/44981372-5df2-487e-b23d-733275062959-kube-api-access-bhqcd\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.013377 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.013359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/44981372-5df2-487e-b23d-733275062959-redirect-config\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.027366 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.027343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqcd\" (UniqueName: \"kubernetes.io/projected/44981372-5df2-487e-b23d-733275062959-kube-api-access-bhqcd\") pod \"dashboard-redirect-6b97469585-kzlmv\" (UID: \"44981372-5df2-487e-b23d-733275062959\") " pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.169334 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.169282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" Jun 09 02:30:55.292071 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.292033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b97469585-kzlmv"] Jun 09 02:30:55.295435 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:30:55.295412 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44981372_5df2_487e_b23d_733275062959.slice/crio-adfdcf67c2d4592e33b4e8d828b3f99d33804bd760fc42552b5924b3590bbc40 WatchSource:0}: Error finding container adfdcf67c2d4592e33b4e8d828b3f99d33804bd760fc42552b5924b3590bbc40: Status 404 returned error can't find the container with id adfdcf67c2d4592e33b4e8d828b3f99d33804bd760fc42552b5924b3590bbc40 Jun 09 02:30:55.322330 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:55.322307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" event={"ID":"44981372-5df2-487e-b23d-733275062959","Type":"ContainerStarted","Data":"adfdcf67c2d4592e33b4e8d828b3f99d33804bd760fc42552b5924b3590bbc40"} Jun 09 02:30:58.335724 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:58.335682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" event={"ID":"44981372-5df2-487e-b23d-733275062959","Type":"ContainerStarted","Data":"176b02f78efee85328d8823960275815a48572f77bb400035a5dece31fcd7b38"} Jun 09 02:30:58.354278 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:30:58.353066 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6b97469585-kzlmv" podStartSLOduration=2.208182471 podStartE2EDuration="4.35304938s" totalImagesPullingTime="2.144866909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:30:58.35166062 +0000 UTC m=+557.514030859" watchObservedRunningTime="2026-06-09 02:30:58.35304938 +0000 UTC m=+557.515419624" Jun 09 02:31:00.545474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.545436 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q"] Jun 09 02:31:00.547979 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.547958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.550236 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.550202 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 02:31:00.550344 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.550260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 02:31:00.550344 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.550263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 02:31:00.550432 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.550301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m49mr\"" Jun 09 02:31:00.560334 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.560312 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q"] Jun 09 02:31:00.648612 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648720 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648720 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648720 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjnhn\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-kube-api-access-hjnhn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648946 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.648981 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.648936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750220 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750220 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750363 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750363 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750363 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750363 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjnhn\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-kube-api-access-hjnhn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750363 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750597 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750597 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750723 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.750974 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.751063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.750973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.751063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.751007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.751063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.751031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.752536 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.752509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.752705 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.752687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.761063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.761044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjnhn\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-kube-api-access-hjnhn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.761299 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.761282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1333c3e7-21d3-4dc6-88a0-a35b5df69d3a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtl8q\" (UID: \"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.857404 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.857348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:00.986196 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:00.986165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q"] Jun 09 02:31:00.988970 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:31:00.988945 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1333c3e7_21d3_4dc6_88a0_a35b5df69d3a.slice/crio-a27896d840de47d3cb6409b3943770906a79103bc6dc72062b34e3a998a78799 WatchSource:0}: Error finding container a27896d840de47d3cb6409b3943770906a79103bc6dc72062b34e3a998a78799: Status 404 returned error can't find the container with id a27896d840de47d3cb6409b3943770906a79103bc6dc72062b34e3a998a78799 Jun 09 02:31:01.347063 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:01.347036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" event={"ID":"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a","Type":"ContainerStarted","Data":"a27896d840de47d3cb6409b3943770906a79103bc6dc72062b34e3a998a78799"} Jun 09 02:31:03.699141 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:03.699104 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:31:03.699386 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:03.699177 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:31:03.699386 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:03.699205 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:31:04.360326 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:04.360294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" event={"ID":"1333c3e7-21d3-4dc6-88a0-a35b5df69d3a","Type":"ContainerStarted","Data":"9cdba6d24fd368740787fcff774879f8eb738339ad32747f9f8322fc34beba0f"} Jun 09 02:31:04.379840 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:04.379763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" podStartSLOduration=1.671956215 podStartE2EDuration="4.379745165s" totalImagesPullingTime="2.70778895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:31:04.378689731 +0000 UTC m=+563.541059979" watchObservedRunningTime="2026-06-09 02:31:04.379745165 +0000 UTC m=+563.542115410" Jun 09 02:31:04.858299 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:04.858267 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:04.862673 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:04.862652 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:05.364178 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:05.364153 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:05.364892 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:05.364870 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtl8q" Jun 09 02:31:41.279054 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:41.279029 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:31:41.279484 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:31:41.279310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:32:01.377507 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.374226 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z"] Jun 09 02:32:01.379789 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.378634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:01.381677 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.381656 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 02:32:01.381831 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.381706 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 02:32:01.382481 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.382464 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m7x7w\"" Jun 09 02:32:01.399428 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.399404 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z"] Jun 09 02:32:01.474853 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.474825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pt6v\" (UniqueName: \"kubernetes.io/projected/fa79d061-01d9-40e4-be4c-f02f54ee6874-kube-api-access-5pt6v\") pod \"authorino-operator-75cc8d5cb7-qtz9z\" (UID: \"fa79d061-01d9-40e4-be4c-f02f54ee6874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:01.575196 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.575170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pt6v\" (UniqueName: \"kubernetes.io/projected/fa79d061-01d9-40e4-be4c-f02f54ee6874-kube-api-access-5pt6v\") pod \"authorino-operator-75cc8d5cb7-qtz9z\" (UID: \"fa79d061-01d9-40e4-be4c-f02f54ee6874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:01.582829 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.582792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pt6v\" (UniqueName: \"kubernetes.io/projected/fa79d061-01d9-40e4-be4c-f02f54ee6874-kube-api-access-5pt6v\") pod \"authorino-operator-75cc8d5cb7-qtz9z\" (UID: \"fa79d061-01d9-40e4-be4c-f02f54ee6874\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:01.688822 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.688757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:01.820504 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:01.820479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z"] Jun 09 02:32:01.823170 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:32:01.823143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa79d061_01d9_40e4_be4c_f02f54ee6874.slice/crio-0d20b635099f87b62af4a8efcecaf9c0fc34e0609edbd5e275fe0c3b784b637b WatchSource:0}: Error finding container 0d20b635099f87b62af4a8efcecaf9c0fc34e0609edbd5e275fe0c3b784b637b: Status 404 returned error can't find the container with id 0d20b635099f87b62af4a8efcecaf9c0fc34e0609edbd5e275fe0c3b784b637b Jun 09 02:32:02.580522 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:02.580485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" event={"ID":"fa79d061-01d9-40e4-be4c-f02f54ee6874","Type":"ContainerStarted","Data":"0d20b635099f87b62af4a8efcecaf9c0fc34e0609edbd5e275fe0c3b784b637b"} Jun 09 02:32:03.981461 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:03.981428 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9"] Jun 09 02:32:03.984764 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:03.984741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:03.987542 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:03.987522 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x8tl7\"" Jun 09 02:32:03.995440 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:03.995416 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9"] Jun 09 02:32:04.095553 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.095512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txsx\" (UniqueName: \"kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx\") pod \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" (UID: \"0d363938-a40d-4977-ac15-8207d0980191\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:04.196600 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.196564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txsx\" (UniqueName: \"kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx\") pod \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" (UID: \"0d363938-a40d-4977-ac15-8207d0980191\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:04.207466 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.207441 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txsx\" (UniqueName: \"kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx\") pod \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" (UID: \"0d363938-a40d-4977-ac15-8207d0980191\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:04.297479 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.297456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:04.423480 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.423451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9"] Jun 09 02:32:04.426686 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:32:04.426652 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d363938_a40d_4977_ac15_8207d0980191.slice/crio-d96b4c3844f1a1619e517872fca36ddac7bcf9c86467d6a6098d558e057afad1 WatchSource:0}: Error finding container d96b4c3844f1a1619e517872fca36ddac7bcf9c86467d6a6098d558e057afad1: Status 404 returned error can't find the container with id d96b4c3844f1a1619e517872fca36ddac7bcf9c86467d6a6098d558e057afad1 Jun 09 02:32:04.590843 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.590816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" event={"ID":"fa79d061-01d9-40e4-be4c-f02f54ee6874","Type":"ContainerStarted","Data":"4195ac2a49b996b08c874dd378d63c483c6b139e4dfcdfe28031fb3c352237c2"} Jun 09 02:32:04.590984 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.590884 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:04.591965 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.591943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" event={"ID":"0d363938-a40d-4977-ac15-8207d0980191","Type":"ContainerStarted","Data":"d96b4c3844f1a1619e517872fca36ddac7bcf9c86467d6a6098d558e057afad1"} Jun 09 02:32:04.610832 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:04.610788 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" podStartSLOduration=1.171339895 podStartE2EDuration="3.610758803s" totalImagesPullingTime="2.439418908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:04.608910098 +0000 UTC m=+623.771280342" watchObservedRunningTime="2026-06-09 02:32:04.610758803 +0000 UTC m=+623.773129047" Jun 09 02:32:06.602535 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:06.602505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" event={"ID":"0d363938-a40d-4977-ac15-8207d0980191","Type":"ContainerStarted","Data":"b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da"} Jun 09 02:32:06.602864 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:06.602639 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:06.617600 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:06.617557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" podStartSLOduration=1.5963904279999999 podStartE2EDuration="3.617544249s" totalImagesPullingTime="2.021153821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:06.615960257 +0000 UTC m=+625.778330525" watchObservedRunningTime="2026-06-09 02:32:06.617544249 +0000 UTC m=+625.779914493" Jun 09 02:32:15.599053 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:15.599020 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qtz9z" Jun 09 02:32:17.608642 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:17.608613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.026653 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.026620 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9"] Jun 09 02:32:18.026977 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.026949 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" podUID="0d363938-a40d-4977-ac15-8207d0980191" containerName="manager" containerID="cri-o://b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da" gracePeriod=2 Jun 09 02:32:18.039985 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.039956 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9"] Jun 09 02:32:18.046896 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.046865 2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0d363938-a40d-4977-ac15-8207d0980191\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-qdqq9\": pods \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.277914 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.277859 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.279934 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.279906 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" is forbidden: User \"system:node:ip-10-0-138-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-26.ec2.internal' and this object" podUID="0d363938-a40d-4977-ac15-8207d0980191" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.333954 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.333926 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq"] Jun 09 02:32:18.334215 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.334203 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d363938-a40d-4977-ac15-8207d0980191" containerName="manager" Jun 09 02:32:18.334257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.334217 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d363938-a40d-4977-ac15-8207d0980191" containerName="manager" Jun 09 02:32:18.334290 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.334270 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d363938-a40d-4977-ac15-8207d0980191" containerName="manager" Jun 09 02:32:18.336972 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.336955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.339333 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.339315 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zkgr7\"" Jun 09 02:32:18.347471 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.347451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq"] Jun 09 02:32:18.369532 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.369504 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" is forbidden: User \"system:node:ip-10-0-138-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-26.ec2.internal' and this object" podUID="0d363938-a40d-4977-ac15-8207d0980191" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.391809 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.391785 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txsx\" (UniqueName: \"kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx\") pod \"0d363938-a40d-4977-ac15-8207d0980191\" (UID: \"0d363938-a40d-4977-ac15-8207d0980191\") " Jun 09 02:32:18.393809 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.393782 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx" (OuterVolumeSpecName: "kube-api-access-8txsx") pod "0d363938-a40d-4977-ac15-8207d0980191" (UID: "0d363938-a40d-4977-ac15-8207d0980191"). InnerVolumeSpecName "kube-api-access-8txsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:32:18.492942 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.492917 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc524\" (UniqueName: \"kubernetes.io/projected/151635b3-265a-4f6f-a746-0541c7a9fb39-kube-api-access-xc524\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.493025 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.492953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/151635b3-265a-4f6f-a746-0541c7a9fb39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.493025 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.493015 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txsx\" (UniqueName: \"kubernetes.io/projected/0d363938-a40d-4977-ac15-8207d0980191-kube-api-access-8txsx\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:32:18.594119 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.594059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/151635b3-265a-4f6f-a746-0541c7a9fb39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.594119 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.594116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc524\" (UniqueName: \"kubernetes.io/projected/151635b3-265a-4f6f-a746-0541c7a9fb39-kube-api-access-xc524\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.594403 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.594384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/151635b3-265a-4f6f-a746-0541c7a9fb39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.601873 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.601848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc524\" (UniqueName: \"kubernetes.io/projected/151635b3-265a-4f6f-a746-0541c7a9fb39-kube-api-access-xc524\") pod \"kuadrant-operator-controller-manager-86878c769f-7t8xq\" (UID: \"151635b3-265a-4f6f-a746-0541c7a9fb39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.646934 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.646914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:18.653175 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.653154 2577 generic.go:356] "Generic (PLEG): container finished" podID="0d363938-a40d-4977-ac15-8207d0980191" containerID="b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da" exitCode=0 Jun 09 02:32:18.653254 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.653195 2577 scope.go:117] "RemoveContainer" containerID="b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da" Jun 09 02:32:18.653254 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.653202 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.655214 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.655185 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" is forbidden: User \"system:node:ip-10-0-138-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-26.ec2.internal' and this object" podUID="0d363938-a40d-4977-ac15-8207d0980191" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.660425 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.660405 2577 scope.go:117] "RemoveContainer" containerID="b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da" Jun 09 02:32:18.660748 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.660728 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da\": container with ID starting with b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da not found: ID does not exist" containerID="b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da" Jun 09 02:32:18.660854 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.660760 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da"} err="failed to get container status \"b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da\": rpc error: code = NotFound desc = could not find container \"b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da\": container with ID starting with b1ef95f933550d2fc93254cdce9b2efdd35857fab78765de5b6665456ade23da not found: ID does not exist" Jun 09 02:32:18.664016 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:32:18.663993 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qdqq9\" is forbidden: User \"system:node:ip-10-0-138-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-26.ec2.internal' and this object" podUID="0d363938-a40d-4977-ac15-8207d0980191" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qdqq9" Jun 09 02:32:18.771019 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:18.770980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq"] Jun 09 02:32:18.774383 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:32:18.774357 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151635b3_265a_4f6f_a746_0541c7a9fb39.slice/crio-203acddc3aaf24d19a7d9529b3c2c134f1c0f29cd64f1f8d6fc0bea3ffb891de WatchSource:0}: Error finding container 203acddc3aaf24d19a7d9529b3c2c134f1c0f29cd64f1f8d6fc0bea3ffb891de: Status 404 returned error can't find the container with id 203acddc3aaf24d19a7d9529b3c2c134f1c0f29cd64f1f8d6fc0bea3ffb891de Jun 09 02:32:19.310119 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:19.310084 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d363938-a40d-4977-ac15-8207d0980191" path="/var/lib/kubelet/pods/0d363938-a40d-4977-ac15-8207d0980191/volumes" Jun 09 02:32:19.660694 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:19.660624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" event={"ID":"151635b3-265a-4f6f-a746-0541c7a9fb39","Type":"ContainerStarted","Data":"203acddc3aaf24d19a7d9529b3c2c134f1c0f29cd64f1f8d6fc0bea3ffb891de"} Jun 09 02:32:22.674139 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:22.674110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" event={"ID":"151635b3-265a-4f6f-a746-0541c7a9fb39","Type":"ContainerStarted","Data":"f13c92aa9612e82d7d4c0a6e7a21e6f4f9d3ebbc996c446285f4490f40b79d4f"} Jun 09 02:32:22.674461 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:22.674180 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:22.696027 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:22.695982 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" podStartSLOduration=0.948601795 podStartE2EDuration="4.695965277s" totalImagesPullingTime="3.747363482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:22.694240659 +0000 UTC m=+641.856610902" watchObservedRunningTime="2026-06-09 02:32:22.695965277 +0000 UTC m=+641.858335523" Jun 09 02:32:33.680512 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:33.680481 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t8xq" Jun 09 02:32:49.946902 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:49.946868 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p"] Jun 09 02:32:49.953247 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:49.953226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:49.955524 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:49.955501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lf7td\"" Jun 09 02:32:49.961094 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:49.961038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p"] Jun 09 02:32:50.006549 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006549 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006701 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006701 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27958310-9457-401d-b75b-c8adae4cb996-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006701 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frttr\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-kube-api-access-frttr\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006701 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006701 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006902 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.006902 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.006808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27958310-9457-401d-b75b-c8adae4cb996-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107459 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107583 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27958310-9457-401d-b75b-c8adae4cb996-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107583 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frttr\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-kube-api-access-frttr\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107583 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107583 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107820 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107820 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27958310-9457-401d-b75b-c8adae4cb996-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107820 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.107820 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.107699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.108069 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.108044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.108174 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.108153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.108230 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.108182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.108230 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.108206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.108571 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.108550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27958310-9457-401d-b75b-c8adae4cb996-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.109957 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.109937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27958310-9457-401d-b75b-c8adae4cb996-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.110182 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.110164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27958310-9457-401d-b75b-c8adae4cb996-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.114440 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.114418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frttr\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-kube-api-access-frttr\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.114985 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.114964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27958310-9457-401d-b75b-c8adae4cb996-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-b2t8p\" (UID: \"27958310-9457-401d-b75b-c8adae4cb996\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.264865 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.264812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:50.395027 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.395001 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p"] Jun 09 02:32:50.397996 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:32:50.397970 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27958310_9457_401d_b75b_c8adae4cb996.slice/crio-f2338fe1a7895c17dbeb5d04b2f5402e5a8e06674052b3089c28b3b8ffbc5cf8 WatchSource:0}: Error finding container f2338fe1a7895c17dbeb5d04b2f5402e5a8e06674052b3089c28b3b8ffbc5cf8: Status 404 returned error can't find the container with id f2338fe1a7895c17dbeb5d04b2f5402e5a8e06674052b3089c28b3b8ffbc5cf8 Jun 09 02:32:50.400233 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.400200 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:32:50.400340 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.400266 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:32:50.400340 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.400293 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:32:50.789016 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.788983 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" event={"ID":"27958310-9457-401d-b75b-c8adae4cb996","Type":"ContainerStarted","Data":"13dfc1866f221da8c6a1ed40832bd4a457aaa26bf908f5a449f0b3f11bab447f"} Jun 09 02:32:50.789182 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.789031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" event={"ID":"27958310-9457-401d-b75b-c8adae4cb996","Type":"ContainerStarted","Data":"f2338fe1a7895c17dbeb5d04b2f5402e5a8e06674052b3089c28b3b8ffbc5cf8"} Jun 09 02:32:50.808448 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:50.808391 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" podStartSLOduration=1.808371217 podStartE2EDuration="1.808371217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:50.80601504 +0000 UTC m=+669.968385283" watchObservedRunningTime="2026-06-09 02:32:50.808371217 +0000 UTC m=+669.970741462" Jun 09 02:32:51.265852 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:51.265754 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:51.270181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:51.270155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:51.793401 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:51.793365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:51.794441 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:51.794418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:32:54.885724 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:54.885687 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:32:54.911521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:54.911493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:32:54.911521 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:54.911505 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:32:54.913863 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:54.913845 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l5ttf\"" Jun 09 02:32:54.945970 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:54.945941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6m6\" (UniqueName: \"kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6\") pod \"authorino-75d556bd77-p5zrc\" (UID: \"ef81758e-5854-4667-99cd-409b7a15b1a1\") " pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:32:55.046433 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:55.046411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6m6\" (UniqueName: \"kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6\") pod \"authorino-75d556bd77-p5zrc\" (UID: \"ef81758e-5854-4667-99cd-409b7a15b1a1\") " pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:32:55.053259 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:55.053240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6m6\" (UniqueName: \"kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6\") pod \"authorino-75d556bd77-p5zrc\" (UID: \"ef81758e-5854-4667-99cd-409b7a15b1a1\") " pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:32:55.220897 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:55.220843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:32:55.342246 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:55.342218 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:32:55.345748 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:32:55.345722 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef81758e_5854_4667_99cd_409b7a15b1a1.slice/crio-9d4da7d98cc684bc41bc1beda2d281a7ee9f191d84351ef5882e37158b614b1a WatchSource:0}: Error finding container 9d4da7d98cc684bc41bc1beda2d281a7ee9f191d84351ef5882e37158b614b1a: Status 404 returned error can't find the container with id 9d4da7d98cc684bc41bc1beda2d281a7ee9f191d84351ef5882e37158b614b1a Jun 09 02:32:55.810650 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:55.810618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p5zrc" event={"ID":"ef81758e-5854-4667-99cd-409b7a15b1a1","Type":"ContainerStarted","Data":"9d4da7d98cc684bc41bc1beda2d281a7ee9f191d84351ef5882e37158b614b1a"} Jun 09 02:32:58.826917 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:58.826882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p5zrc" event={"ID":"ef81758e-5854-4667-99cd-409b7a15b1a1","Type":"ContainerStarted","Data":"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6"} Jun 09 02:32:58.841061 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:32:58.841015 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p5zrc" podStartSLOduration=1.734174517 podStartE2EDuration="4.841000393s" totalImagesPullingTime="3.106825876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:32:58.839788517 +0000 UTC m=+678.002158753" watchObservedRunningTime="2026-06-09 02:32:58.841000393 +0000 UTC m=+678.003370657" Jun 09 02:33:50.178846 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.178812 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:33:50.183268 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.183245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:50.185501 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.185477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nrpff\"" Jun 09 02:33:50.185628 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.185544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 02:33:50.185628 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.185564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 02:33:50.186187 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.186169 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 02:33:50.189679 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.189659 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:33:50.349522 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.349493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k772c\" (UniqueName: \"kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c\") pod \"maas-keycloak-0\" (UID: \"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:50.450426 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.450366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k772c\" (UniqueName: \"kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c\") pod \"maas-keycloak-0\" (UID: \"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:50.457862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.457833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k772c\" (UniqueName: \"kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c\") pod \"maas-keycloak-0\" (UID: \"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:50.493715 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.493691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:50.616149 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:50.616122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:33:50.618630 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:33:50.618600 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42c5ba7_5087_4bbd_b3ea_e7f3c3ed969e.slice/crio-5e9065a2fddc7992bee3cac82049b466120f9b4e411a4723df76a3b8a6d11e8f WatchSource:0}: Error finding container 5e9065a2fddc7992bee3cac82049b466120f9b4e411a4723df76a3b8a6d11e8f: Status 404 returned error can't find the container with id 5e9065a2fddc7992bee3cac82049b466120f9b4e411a4723df76a3b8a6d11e8f Jun 09 02:33:51.049960 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:51.049926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e","Type":"ContainerStarted","Data":"5e9065a2fddc7992bee3cac82049b466120f9b4e411a4723df76a3b8a6d11e8f"} Jun 09 02:33:57.079792 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:57.079530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e","Type":"ContainerStarted","Data":"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b"} Jun 09 02:33:57.099793 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:57.095741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.671121037 podStartE2EDuration="7.095719202s" totalImagesPullingTime="5.424598165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:33:57.094464029 +0000 UTC m=+736.256834273" watchObservedRunningTime="2026-06-09 02:33:57.095719202 +0000 UTC m=+736.258089447" Jun 09 02:33:57.494589 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:57.494473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 02:33:57.496376 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:57.496318 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:33:58.495035 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:58.494985 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:33:59.494782 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:33:59.494724 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:00.493902 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:00.493846 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:34:00.494355 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:00.494087 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:01.495067 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:01.494997 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:02.494538 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:02.494490 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:03.494974 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:03.494927 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:04.494750 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:04.494684 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:05.495146 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:05.495098 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:06.494452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:06.494398 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:07.495227 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:07.495171 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:08.494336 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:08.494288 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.24:9000/health/started\": dial tcp 10.132.0.24:9000: connect: connection refused" Jun 09 02:34:09.597583 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:09.597547 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 02:34:09.611143 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:09.611066 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:34:19.603950 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:19.603918 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:34:20.457427 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.457391 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xh2jf"] Jun 09 02:34:20.465741 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.465711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:20.466026 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.466005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xh2jf"] Jun 09 02:34:20.603675 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.603635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc54v\" (UniqueName: \"kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v\") pod \"authorino-5d4b67c446-xh2jf\" (UID: \"94cbe1ec-5cbe-416b-b30d-204641eeb06f\") " pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:20.635700 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.635662 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xh2jf"] Jun 09 02:34:20.636109 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:34:20.635942 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sc54v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-xh2jf" podUID="94cbe1ec-5cbe-416b-b30d-204641eeb06f" Jun 09 02:34:20.660827 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.660800 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-tqqxn"] Jun 09 02:34:20.662981 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.662959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.665051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.665034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 02:34:20.672554 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.672531 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-tqqxn"] Jun 09 02:34:20.701198 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.701179 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-tqqxn"] Jun 09 02:34:20.704786 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:34:20.701960 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jjxvx tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-jjxvx tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-tqqxn" podUID="6f67052e-62a3-48cb-9210-2e915fe843dd" Jun 09 02:34:20.706293 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.706210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc54v\" (UniqueName: \"kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v\") pod \"authorino-5d4b67c446-xh2jf\" (UID: \"94cbe1ec-5cbe-416b-b30d-204641eeb06f\") " pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:20.714250 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.714203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc54v\" (UniqueName: \"kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v\") pod \"authorino-5d4b67c446-xh2jf\" (UID: \"94cbe1ec-5cbe-416b-b30d-204641eeb06f\") " pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:20.727358 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.727333 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:34:20.729479 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.729461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.737413 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.737387 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:34:20.807269 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.807242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjxvx\" (UniqueName: \"kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.807368 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.807280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.807408 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.807369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.807443 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.807410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897qt\" (UniqueName: \"kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.908753 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.908729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.908866 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.908802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897qt\" (UniqueName: \"kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.908866 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.908848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjxvx\" (UniqueName: \"kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.908987 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.908968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.911125 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.911098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:20.911125 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.911120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.917229 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.917204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-897qt\" (UniqueName: \"kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt\") pod \"authorino-5cd8c6fc5-rnmjz\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:20.917597 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:20.917573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjxvx\" (UniqueName: \"kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx\") pod \"authorino-76877994-tqqxn\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:21.038983 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.038964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:34:21.161921 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.161889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:34:21.164416 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:34:21.164383 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6c407ee_2a1d_4b7b_a467_e6c1b8289372.slice/crio-1eb9ee18b983f17db904daa8482ec259cdb963ae0f75dea38ae56a3ba54920ab WatchSource:0}: Error finding container 1eb9ee18b983f17db904daa8482ec259cdb963ae0f75dea38ae56a3ba54920ab: Status 404 returned error can't find the container with id 1eb9ee18b983f17db904daa8482ec259cdb963ae0f75dea38ae56a3ba54920ab Jun 09 02:34:21.204571 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.204545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:21.204655 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.204560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" event={"ID":"b6c407ee-2a1d-4b7b-a467-e6c1b8289372","Type":"ContainerStarted","Data":"1eb9ee18b983f17db904daa8482ec259cdb963ae0f75dea38ae56a3ba54920ab"} Jun 09 02:34:21.204725 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.204694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:21.211556 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.211534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:21.213504 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.213489 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:21.311284 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.311240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc54v\" (UniqueName: \"kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v\") pod \"94cbe1ec-5cbe-416b-b30d-204641eeb06f\" (UID: \"94cbe1ec-5cbe-416b-b30d-204641eeb06f\") " Jun 09 02:34:21.311284 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.311268 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjxvx\" (UniqueName: \"kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx\") pod \"6f67052e-62a3-48cb-9210-2e915fe843dd\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " Jun 09 02:34:21.311452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.311299 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert\") pod \"6f67052e-62a3-48cb-9210-2e915fe843dd\" (UID: \"6f67052e-62a3-48cb-9210-2e915fe843dd\") " Jun 09 02:34:21.313284 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.313257 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6f67052e-62a3-48cb-9210-2e915fe843dd" (UID: "6f67052e-62a3-48cb-9210-2e915fe843dd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:34:21.313366 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.313293 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx" (OuterVolumeSpecName: "kube-api-access-jjxvx") pod "6f67052e-62a3-48cb-9210-2e915fe843dd" (UID: "6f67052e-62a3-48cb-9210-2e915fe843dd"). InnerVolumeSpecName "kube-api-access-jjxvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:34:21.313366 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.313311 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v" (OuterVolumeSpecName: "kube-api-access-sc54v") pod "94cbe1ec-5cbe-416b-b30d-204641eeb06f" (UID: "94cbe1ec-5cbe-416b-b30d-204641eeb06f"). InnerVolumeSpecName "kube-api-access-sc54v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:34:21.412442 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.412417 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc54v\" (UniqueName: \"kubernetes.io/projected/94cbe1ec-5cbe-416b-b30d-204641eeb06f-kube-api-access-sc54v\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:34:21.412538 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.412512 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjxvx\" (UniqueName: \"kubernetes.io/projected/6f67052e-62a3-48cb-9210-2e915fe843dd-kube-api-access-jjxvx\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:34:21.412538 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:21.412524 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f67052e-62a3-48cb-9210-2e915fe843dd-tls-cert\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:34:22.210800 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.210744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xh2jf" Jun 09 02:34:22.211233 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.210741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" event={"ID":"b6c407ee-2a1d-4b7b-a467-e6c1b8289372","Type":"ContainerStarted","Data":"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec"} Jun 09 02:34:22.211233 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.211065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tqqxn" Jun 09 02:34:22.224858 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.224810 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" podStartSLOduration=1.8749446029999999 podStartE2EDuration="2.224795648s" totalImagesPullingTime="349.851045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:34:22.223838666 +0000 UTC m=+761.386208910" watchObservedRunningTime="2026-06-09 02:34:22.224795648 +0000 UTC m=+761.387165883" Jun 09 02:34:22.248786 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.248741 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-tqqxn"] Jun 09 02:34:22.252716 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.252633 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:34:22.252910 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.252854 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p5zrc" podUID="ef81758e-5854-4667-99cd-409b7a15b1a1" containerName="authorino" containerID="cri-o://f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6" gracePeriod=30 Jun 09 02:34:22.255630 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.255600 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-tqqxn"] Jun 09 02:34:22.275669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.275644 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xh2jf"] Jun 09 02:34:22.279242 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.279212 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xh2jf"] Jun 09 02:34:22.491817 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.491795 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:34:22.620087 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.620055 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps6m6\" (UniqueName: \"kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6\") pod \"ef81758e-5854-4667-99cd-409b7a15b1a1\" (UID: \"ef81758e-5854-4667-99cd-409b7a15b1a1\") " Jun 09 02:34:22.622098 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.622030 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6" (OuterVolumeSpecName: "kube-api-access-ps6m6") pod "ef81758e-5854-4667-99cd-409b7a15b1a1" (UID: "ef81758e-5854-4667-99cd-409b7a15b1a1"). InnerVolumeSpecName "kube-api-access-ps6m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:34:22.720502 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:22.720480 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps6m6\" (UniqueName: \"kubernetes.io/projected/ef81758e-5854-4667-99cd-409b7a15b1a1-kube-api-access-ps6m6\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:34:23.216610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.216573 2577 generic.go:356] "Generic (PLEG): container finished" podID="ef81758e-5854-4667-99cd-409b7a15b1a1" containerID="f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6" exitCode=0 Jun 09 02:34:23.217101 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.216638 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p5zrc" Jun 09 02:34:23.217101 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.216661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p5zrc" event={"ID":"ef81758e-5854-4667-99cd-409b7a15b1a1","Type":"ContainerDied","Data":"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6"} Jun 09 02:34:23.217101 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.216706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p5zrc" event={"ID":"ef81758e-5854-4667-99cd-409b7a15b1a1","Type":"ContainerDied","Data":"9d4da7d98cc684bc41bc1beda2d281a7ee9f191d84351ef5882e37158b614b1a"} Jun 09 02:34:23.217101 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.216729 2577 scope.go:117] "RemoveContainer" containerID="f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6" Jun 09 02:34:23.225808 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.225787 2577 scope.go:117] "RemoveContainer" containerID="f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6" Jun 09 02:34:23.226097 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:34:23.226075 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6\": container with ID starting with f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6 not found: ID does not exist" containerID="f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6" Jun 09 02:34:23.226173 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.226108 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6"} err="failed to get container status \"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6\": rpc error: code = NotFound desc = could not find container \"f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6\": container with ID starting with f4a701117ad5935d10e959727b7f574f6028e7323e55ae697f93fab66b5008e6 not found: ID does not exist" Jun 09 02:34:23.236300 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.236273 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:34:23.238871 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.238850 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p5zrc"] Jun 09 02:34:23.307603 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.307580 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f67052e-62a3-48cb-9210-2e915fe843dd" path="/var/lib/kubelet/pods/6f67052e-62a3-48cb-9210-2e915fe843dd/volumes" Jun 09 02:34:23.307826 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.307813 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94cbe1ec-5cbe-416b-b30d-204641eeb06f" path="/var/lib/kubelet/pods/94cbe1ec-5cbe-416b-b30d-204641eeb06f/volumes" Jun 09 02:34:23.308010 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:34:23.307998 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef81758e-5854-4667-99cd-409b7a15b1a1" path="/var/lib/kubelet/pods/ef81758e-5854-4667-99cd-409b7a15b1a1/volumes" Jun 09 02:35:07.834915 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:07.834879 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-b2t8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 09 02:35:07.835328 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:07.834937 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" podUID="27958310-9457-401d-b75b-c8adae4cb996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 09 02:35:08.416534 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.416456 2577 generic.go:356] "Generic (PLEG): container finished" podID="27958310-9457-401d-b75b-c8adae4cb996" containerID="13dfc1866f221da8c6a1ed40832bd4a457aaa26bf908f5a449f0b3f11bab447f" exitCode=0 Jun 09 02:35:08.416674 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.416529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" event={"ID":"27958310-9457-401d-b75b-c8adae4cb996","Type":"ContainerDied","Data":"13dfc1866f221da8c6a1ed40832bd4a457aaa26bf908f5a449f0b3f11bab447f"} Jun 09 02:35:08.416965 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.416945 2577 scope.go:117] "RemoveContainer" containerID="13dfc1866f221da8c6a1ed40832bd4a457aaa26bf908f5a449f0b3f11bab447f" Jun 09 02:35:08.417882 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.417856 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:35:08.417934 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.417925 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:35:08.417972 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:08.417965 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 02:35:09.422705 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:09.422670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" event={"ID":"27958310-9457-401d-b75b-c8adae4cb996","Type":"ContainerStarted","Data":"0d4d3c5dbf3a0eebafbec7ecd535e9787639adadcc7f85ac5221cdc1261a5fbf"} Jun 09 02:35:10.265370 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:10.265336 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:35:10.265547 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:10.265525 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-b2t8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jun 09 02:35:10.265595 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:10.265577 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" podUID="27958310-9457-401d-b75b-c8adae4cb996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jun 09 02:35:11.266023 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:11.265985 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-b2t8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jun 09 02:35:11.266392 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:11.266040 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" podUID="27958310-9457-401d-b75b-c8adae4cb996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jun 09 02:35:11.466376 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:11.466336 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:11.466590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:11.466547 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" containerID="cri-o://4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b" gracePeriod=30 Jun 09 02:35:12.265599 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:12.265561 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-b2t8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jun 09 02:35:12.265862 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:12.265627 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" podUID="27958310-9457-401d-b75b-c8adae4cb996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jun 09 02:35:13.120631 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.120609 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.195452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.195362 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k772c\" (UniqueName: \"kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c\") pod \"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e\" (UID: \"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e\") " Jun 09 02:35:13.197475 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.197449 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c" (OuterVolumeSpecName: "kube-api-access-k772c") pod "d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" (UID: "d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e"). InnerVolumeSpecName "kube-api-access-k772c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:35:13.268514 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.268488 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:35:13.268799 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.268763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:35:13.269386 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.269370 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-b2t8p" Jun 09 02:35:13.296832 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.296806 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k772c\" (UniqueName: \"kubernetes.io/projected/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e-kube-api-access-k772c\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:35:13.443243 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.443213 2577 generic.go:356] "Generic (PLEG): container finished" podID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerID="4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b" exitCode=143 Jun 09 02:35:13.443354 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.443254 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.443354 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.443289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e","Type":"ContainerDied","Data":"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b"} Jun 09 02:35:13.443354 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.443339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e","Type":"ContainerDied","Data":"5e9065a2fddc7992bee3cac82049b466120f9b4e411a4723df76a3b8a6d11e8f"} Jun 09 02:35:13.443468 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.443358 2577 scope.go:117] "RemoveContainer" containerID="4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b" Jun 09 02:35:13.452167 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.452157 2577 scope.go:117] "RemoveContainer" containerID="4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b" Jun 09 02:35:13.452413 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:35:13.452393 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b\": container with ID starting with 4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b not found: ID does not exist" containerID="4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b" Jun 09 02:35:13.452505 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.452418 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b"} err="failed to get container status \"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b\": rpc error: code = NotFound desc = could not find container \"4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b\": container with ID starting with 4baf5f6cfbfe90420af79084284eefc255e5b076eb6009682dfd489ce5b9516b not found: ID does not exist" Jun 09 02:35:13.457661 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.457640 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:13.461319 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.461297 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:13.480590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480570 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:13.480852 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480840 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef81758e-5854-4667-99cd-409b7a15b1a1" containerName="authorino" Jun 09 02:35:13.480903 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480853 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef81758e-5854-4667-99cd-409b7a15b1a1" containerName="authorino" Jun 09 02:35:13.480903 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480862 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" Jun 09 02:35:13.480903 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480867 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" Jun 09 02:35:13.481004 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480918 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef81758e-5854-4667-99cd-409b7a15b1a1" containerName="authorino" Jun 09 02:35:13.481004 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.480926 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" containerName="keycloak" Jun 09 02:35:13.483463 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.483448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.485557 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.485531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 02:35:13.485708 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.485689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 02:35:13.485757 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.485709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 02:35:13.486181 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.486164 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nrpff\"" Jun 09 02:35:13.486318 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.486302 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 02:35:13.492614 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.492597 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:13.498791 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.498758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4hw\" (UniqueName: \"kubernetes.io/projected/29551300-e5ca-47b9-94fe-aedda12300d6-kube-api-access-st4hw\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.498880 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.498847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29551300-e5ca-47b9-94fe-aedda12300d6-test-realms\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.599656 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.599632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29551300-e5ca-47b9-94fe-aedda12300d6-test-realms\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.599766 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.599696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4hw\" (UniqueName: \"kubernetes.io/projected/29551300-e5ca-47b9-94fe-aedda12300d6-kube-api-access-st4hw\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.600330 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.600311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/29551300-e5ca-47b9-94fe-aedda12300d6-test-realms\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.607080 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.607054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4hw\" (UniqueName: \"kubernetes.io/projected/29551300-e5ca-47b9-94fe-aedda12300d6-kube-api-access-st4hw\") pod \"maas-keycloak-0\" (UID: \"29551300-e5ca-47b9-94fe-aedda12300d6\") " pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.793486 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.793462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:13.916287 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.916255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 02:35:13.919227 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:35:13.919188 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29551300_e5ca_47b9_94fe_aedda12300d6.slice/crio-459ad2730d2d637c42fad7ae22809c84db7e97709956e87cd637fc94cf8bf897 WatchSource:0}: Error finding container 459ad2730d2d637c42fad7ae22809c84db7e97709956e87cd637fc94cf8bf897: Status 404 returned error can't find the container with id 459ad2730d2d637c42fad7ae22809c84db7e97709956e87cd637fc94cf8bf897 Jun 09 02:35:13.920664 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:13.920646 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 02:35:14.453414 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:14.453333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29551300-e5ca-47b9-94fe-aedda12300d6","Type":"ContainerStarted","Data":"2d7aa52b7be0b1de8a4a581a3a35b318c91d3b31bfe97b977ec5093b9aff4e17"} Jun 09 02:35:14.454166 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:14.453440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"29551300-e5ca-47b9-94fe-aedda12300d6","Type":"ContainerStarted","Data":"459ad2730d2d637c42fad7ae22809c84db7e97709956e87cd637fc94cf8bf897"} Jun 09 02:35:14.471067 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:14.471010 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.169337355 podStartE2EDuration="1.470992467s" totalImagesPullingTime="301.655112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:35:14.469156146 +0000 UTC m=+813.631526391" watchObservedRunningTime="2026-06-09 02:35:14.470992467 +0000 UTC m=+813.633362715" Jun 09 02:35:14.794474 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:14.794434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:14.795837 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:14.795804 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:15.311009 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:15.310941 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e" path="/var/lib/kubelet/pods/d42c5ba7-5087-4bbd-b3ea-e7f3c3ed969e/volumes" Jun 09 02:35:15.794365 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:15.794313 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:16.794906 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:16.794852 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:17.794856 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:17.794806 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:18.794257 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:18.794211 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:19.794711 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:19.794671 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:20.794970 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:20.794491 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:21.794338 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:21.794282 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:22.793898 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:22.793847 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:23.794202 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:23.794158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:23.794600 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:23.794350 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:24.794598 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:24.794550 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:25.794209 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:25.794157 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:26.794115 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:26.794065 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 09 02:35:27.918247 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:27.918195 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:27.935644 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:27.935595 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="29551300-e5ca-47b9-94fe-aedda12300d6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 02:35:37.924986 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:37.924954 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 02:35:49.980584 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:49.980549 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:35:49.981024 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:49.980759 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" podUID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" containerName="authorino" containerID="cri-o://456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec" gracePeriod=30 Jun 09 02:35:50.230808 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.230744 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:35:50.416655 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.416622 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-897qt\" (UniqueName: \"kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt\") pod \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " Jun 09 02:35:50.416655 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.416661 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert\") pod \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\" (UID: \"b6c407ee-2a1d-4b7b-a467-e6c1b8289372\") " Jun 09 02:35:50.418760 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.418722 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt" (OuterVolumeSpecName: "kube-api-access-897qt") pod "b6c407ee-2a1d-4b7b-a467-e6c1b8289372" (UID: "b6c407ee-2a1d-4b7b-a467-e6c1b8289372"). InnerVolumeSpecName "kube-api-access-897qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 02:35:50.426007 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.425974 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b6c407ee-2a1d-4b7b-a467-e6c1b8289372" (UID: "b6c407ee-2a1d-4b7b-a467-e6c1b8289372"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 02:35:50.517271 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.517206 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-897qt\" (UniqueName: \"kubernetes.io/projected/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-kube-api-access-897qt\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:35:50.517271 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.517234 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c407ee-2a1d-4b7b-a467-e6c1b8289372-tls-cert\") on node \"ip-10-0-138-26.ec2.internal\" DevicePath \"\"" Jun 09 02:35:50.647927 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.647898 2577 generic.go:356] "Generic (PLEG): container finished" podID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" containerID="456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec" exitCode=0 Jun 09 02:35:50.648034 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.647948 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" Jun 09 02:35:50.648034 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.647959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" event={"ID":"b6c407ee-2a1d-4b7b-a467-e6c1b8289372","Type":"ContainerDied","Data":"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec"} Jun 09 02:35:50.648034 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.647994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8c6fc5-rnmjz" event={"ID":"b6c407ee-2a1d-4b7b-a467-e6c1b8289372","Type":"ContainerDied","Data":"1eb9ee18b983f17db904daa8482ec259cdb963ae0f75dea38ae56a3ba54920ab"} Jun 09 02:35:50.648034 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.648010 2577 scope.go:117] "RemoveContainer" containerID="456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec" Jun 09 02:35:50.658054 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.658032 2577 scope.go:117] "RemoveContainer" containerID="456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec" Jun 09 02:35:50.658331 ip-10-0-138-26 kubenswrapper[2577]: E0609 02:35:50.658305 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec\": container with ID starting with 456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec not found: ID does not exist" containerID="456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec" Jun 09 02:35:50.658441 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.658339 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec"} err="failed to get container status \"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec\": rpc error: code = NotFound desc = could not find container \"456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec\": container with ID starting with 456b9aa3a3640d6acc931065a89ae1b0e64b2b391198fd01bd0f3b24e6ed64ec not found: ID does not exist" Jun 09 02:35:50.672068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.672046 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:35:50.675411 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:50.675391 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cd8c6fc5-rnmjz"] Jun 09 02:35:51.308753 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:35:51.308718 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" path="/var/lib/kubelet/pods/b6c407ee-2a1d-4b7b-a467-e6c1b8289372/volumes" Jun 09 02:36:04.983282 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.983249 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb"] Jun 09 02:36:04.983855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.983687 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" containerName="authorino" Jun 09 02:36:04.983855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.983707 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" containerName="authorino" Jun 09 02:36:04.983855 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.983801 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c407ee-2a1d-4b7b-a467-e6c1b8289372" containerName="authorino" Jun 09 02:36:04.987546 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.987521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:04.989810 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.989758 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 02:36:04.990745 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.990721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 02:36:04.990858 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.990764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 02:36:04.990978 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.990957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wd5j\"" Jun 09 02:36:04.996882 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:04.996861 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb"] Jun 09 02:36:05.022375 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.022545 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.022545 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frbl\" (UniqueName: \"kubernetes.io/projected/564a8c2b-a706-4983-b010-b2c9df973528-kube-api-access-5frbl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.022545 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.022679 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.022679 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.022586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564a8c2b-a706-4983-b010-b2c9df973528-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.123841 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564a8c2b-a706-4983-b010-b2c9df973528-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.123950 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.123950 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.123950 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5frbl\" (UniqueName: \"kubernetes.io/projected/564a8c2b-a706-4983-b010-b2c9df973528-kube-api-access-5frbl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.124120 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.124120 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.123981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.124433 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.124403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.124541 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.124415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.124541 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.124480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.126454 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.126433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/564a8c2b-a706-4983-b010-b2c9df973528-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.126564 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.126543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/564a8c2b-a706-4983-b010-b2c9df973528-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.130746 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.130728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frbl\" (UniqueName: \"kubernetes.io/projected/564a8c2b-a706-4983-b010-b2c9df973528-kube-api-access-5frbl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dtkhb\" (UID: \"564a8c2b-a706-4983-b010-b2c9df973528\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.298847 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.298807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:05.425450 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.425424 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb"] Jun 09 02:36:05.427933 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:36:05.427902 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564a8c2b_a706_4983_b010_b2c9df973528.slice/crio-bf078f41bbd93f4e61597c912c3c37c63b3152697bb15cf93111faf6fe056790 WatchSource:0}: Error finding container bf078f41bbd93f4e61597c912c3c37c63b3152697bb15cf93111faf6fe056790: Status 404 returned error can't find the container with id bf078f41bbd93f4e61597c912c3c37c63b3152697bb15cf93111faf6fe056790 Jun 09 02:36:05.716664 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:05.716580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" event={"ID":"564a8c2b-a706-4983-b010-b2c9df973528","Type":"ContainerStarted","Data":"bf078f41bbd93f4e61597c912c3c37c63b3152697bb15cf93111faf6fe056790"} Jun 09 02:36:09.742623 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:09.742584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" event={"ID":"564a8c2b-a706-4983-b010-b2c9df973528","Type":"ContainerStarted","Data":"5ed51c0d0a9e67e63fce9dcbe30ad0b9ac2660d5e83c77969394ef94a17f1fa2"} Jun 09 02:36:10.748875 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:10.748836 2577 generic.go:356] "Generic (PLEG): container finished" podID="564a8c2b-a706-4983-b010-b2c9df973528" containerID="5ed51c0d0a9e67e63fce9dcbe30ad0b9ac2660d5e83c77969394ef94a17f1fa2" exitCode=0 Jun 09 02:36:10.749276 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:10.748917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" event={"ID":"564a8c2b-a706-4983-b010-b2c9df973528","Type":"ContainerDied","Data":"5ed51c0d0a9e67e63fce9dcbe30ad0b9ac2660d5e83c77969394ef94a17f1fa2"} Jun 09 02:36:12.760251 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:12.760207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" event={"ID":"564a8c2b-a706-4983-b010-b2c9df973528","Type":"ContainerStarted","Data":"0b5726bf34f55696b8c3b06e0178a17c2911caab4a2668dde2714b86a7267d73"} Jun 09 02:36:12.778033 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:12.777979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" podStartSLOduration=3.233436565 podStartE2EDuration="8.777962478s" totalImagesPullingTime="4.299623867s" totalInitContainerRuntime="1.244902046s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:36:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:36:12.776595551 +0000 UTC m=+871.938965795" watchObservedRunningTime="2026-06-09 02:36:12.777962478 +0000 UTC m=+871.940332796" Jun 09 02:36:13.381330 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.381268 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2"] Jun 09 02:36:13.384611 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.384588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.387041 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.387018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 02:36:13.394909 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.394861 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2"] Jun 09 02:36:13.496066 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.496193 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.496193 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.496193 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3462c407-4793-4667-849c-326e8f41015b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.496193 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.496193 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.496185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8t6w\" (UniqueName: \"kubernetes.io/projected/3462c407-4793-4667-849c-326e8f41015b-kube-api-access-l8t6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597206 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597370 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3462c407-4793-4667-849c-326e8f41015b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597370 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597370 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8t6w\" (UniqueName: \"kubernetes.io/projected/3462c407-4793-4667-849c-326e8f41015b-kube-api-access-l8t6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597370 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597592 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597668 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597728 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.597866 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.597815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.599684 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.599658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3462c407-4793-4667-849c-326e8f41015b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.599871 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.599852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3462c407-4793-4667-849c-326e8f41015b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.604630 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.604607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8t6w\" (UniqueName: \"kubernetes.io/projected/3462c407-4793-4667-849c-326e8f41015b-kube-api-access-l8t6w\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2\" (UID: \"3462c407-4793-4667-849c-326e8f41015b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.695933 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.695880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:13.825955 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:13.825927 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2"] Jun 09 02:36:13.828171 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:36:13.828138 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3462c407_4793_4667_849c_326e8f41015b.slice/crio-ee69918d98a0d6cef08477faaa86f5149539259e69ef162805804bebbb02b9ce WatchSource:0}: Error finding container ee69918d98a0d6cef08477faaa86f5149539259e69ef162805804bebbb02b9ce: Status 404 returned error can't find the container with id ee69918d98a0d6cef08477faaa86f5149539259e69ef162805804bebbb02b9ce Jun 09 02:36:14.771389 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:14.771346 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" event={"ID":"3462c407-4793-4667-849c-326e8f41015b","Type":"ContainerStarted","Data":"64f315c600f607ead31b9c40525e51f203acbccb299bff3d60c09318cc4dec3b"} Jun 09 02:36:14.771566 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:14.771437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" event={"ID":"3462c407-4793-4667-849c-326e8f41015b","Type":"ContainerStarted","Data":"ee69918d98a0d6cef08477faaa86f5149539259e69ef162805804bebbb02b9ce"} Jun 09 02:36:15.299651 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.299612 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:15.299999 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.299684 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:15.313039 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.313015 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:15.777117 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.777077 2577 generic.go:356] "Generic (PLEG): container finished" podID="3462c407-4793-4667-849c-326e8f41015b" containerID="64f315c600f607ead31b9c40525e51f203acbccb299bff3d60c09318cc4dec3b" exitCode=0 Jun 09 02:36:15.777260 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.777143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" event={"ID":"3462c407-4793-4667-849c-326e8f41015b","Type":"ContainerDied","Data":"64f315c600f607ead31b9c40525e51f203acbccb299bff3d60c09318cc4dec3b"} Jun 09 02:36:15.789514 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:15.789490 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dtkhb" Jun 09 02:36:16.784041 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:16.784007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" event={"ID":"3462c407-4793-4667-849c-326e8f41015b","Type":"ContainerStarted","Data":"e5b8f8eed7d09ddcef69a97d2a5f59e8d73063f2626cb76ff406e6c09b10f78b"} Jun 09 02:36:16.802751 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:16.802703 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" podStartSLOduration=2.388112172 podStartE2EDuration="3.802688543s" totalImagesPullingTime="198.534149ms" totalInitContainerRuntime="1.216042222s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:36:16.801189446 +0000 UTC m=+875.963559690" watchObservedRunningTime="2026-06-09 02:36:16.802688543 +0000 UTC m=+875.965058786" Jun 09 02:36:23.696983 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:23.696897 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:23.696983 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:23.696968 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:23.709361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:23.709334 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:23.827314 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:23.827283 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2" Jun 09 02:36:28.094817 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.094757 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb"] Jun 09 02:36:28.109696 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.109667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb"] Jun 09 02:36:28.109882 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.109810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.112414 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.112388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 02:36:28.209753 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.209914 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.209914 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.209914 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673cb50f-59ca-41e0-a9bc-431ac336845a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.209914 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7st5\" (UniqueName: \"kubernetes.io/projected/673cb50f-59ca-41e0-a9bc-431ac336845a-kube-api-access-x7st5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.210107 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.209969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310516 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673cb50f-59ca-41e0-a9bc-431ac336845a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7st5\" (UniqueName: \"kubernetes.io/projected/673cb50f-59ca-41e0-a9bc-431ac336845a-kube-api-access-x7st5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310669 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.310989 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.311051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.310997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.311051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.311041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.312584 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.312566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/673cb50f-59ca-41e0-a9bc-431ac336845a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.313099 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.313078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/673cb50f-59ca-41e0-a9bc-431ac336845a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.317857 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.317837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7st5\" (UniqueName: \"kubernetes.io/projected/673cb50f-59ca-41e0-a9bc-431ac336845a-kube-api-access-x7st5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb\" (UID: \"673cb50f-59ca-41e0-a9bc-431ac336845a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.422452 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.422399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:28.548725 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.548703 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb"] Jun 09 02:36:28.550868 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:36:28.550842 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673cb50f_59ca_41e0_a9bc_431ac336845a.slice/crio-2d7ecf6ed1826c49cadacb488387bb2657b9706d9ee1f60999aa1dcf7ef56737 WatchSource:0}: Error finding container 2d7ecf6ed1826c49cadacb488387bb2657b9706d9ee1f60999aa1dcf7ef56737: Status 404 returned error can't find the container with id 2d7ecf6ed1826c49cadacb488387bb2657b9706d9ee1f60999aa1dcf7ef56737 Jun 09 02:36:28.839877 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.839833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" event={"ID":"673cb50f-59ca-41e0-a9bc-431ac336845a","Type":"ContainerStarted","Data":"76acece8c9b73f97e595fca9138c1a3c5e9d263597eaa893472a1c3a20f4a25a"} Jun 09 02:36:28.840028 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:28.839906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" event={"ID":"673cb50f-59ca-41e0-a9bc-431ac336845a","Type":"ContainerStarted","Data":"2d7ecf6ed1826c49cadacb488387bb2657b9706d9ee1f60999aa1dcf7ef56737"} Jun 09 02:36:30.851498 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:30.851462 2577 generic.go:356] "Generic (PLEG): container finished" podID="673cb50f-59ca-41e0-a9bc-431ac336845a" containerID="76acece8c9b73f97e595fca9138c1a3c5e9d263597eaa893472a1c3a20f4a25a" exitCode=0 Jun 09 02:36:30.851912 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:30.851519 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" event={"ID":"673cb50f-59ca-41e0-a9bc-431ac336845a","Type":"ContainerDied","Data":"76acece8c9b73f97e595fca9138c1a3c5e9d263597eaa893472a1c3a20f4a25a"} Jun 09 02:36:31.858629 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.858595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" event={"ID":"673cb50f-59ca-41e0-a9bc-431ac336845a","Type":"ContainerStarted","Data":"79eb42b1a18b2fd07a691a8e5f3e98124bad0b3c4bc705c187ef6bcba5c521ad"} Jun 09 02:36:31.876413 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.876361 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" podStartSLOduration=2.482915114 podStartE2EDuration="3.876345585s" totalImagesPullingTime="162.201363ms" totalInitContainerRuntime="1.231229108s" isStatefulPod=false podCreationTimestamp="2026-06-09 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:36:31.875248393 +0000 UTC m=+891.037618653" watchObservedRunningTime="2026-06-09 02:36:31.876345585 +0000 UTC m=+891.038715896" Jun 09 02:36:31.981528 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.981499 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv"] Jun 09 02:36:31.984709 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.984691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:31.987033 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.987013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 02:36:31.995509 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:31.995483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv"] Jun 09 02:36:32.038172 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.038262 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.038262 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lqq\" (UniqueName: \"kubernetes.io/projected/12383791-0609-4007-9984-8e02d3ecba59-kube-api-access-t5lqq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.038262 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.038360 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12383791-0609-4007-9984-8e02d3ecba59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.038360 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.038342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.138915 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.138857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.138915 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.138895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139032 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.138920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139032 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.138957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lqq\" (UniqueName: \"kubernetes.io/projected/12383791-0609-4007-9984-8e02d3ecba59-kube-api-access-t5lqq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139032 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.139008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139224 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.139199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12383791-0609-4007-9984-8e02d3ecba59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139378 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.139357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139436 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.139376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.139436 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.139408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.141234 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.141215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12383791-0609-4007-9984-8e02d3ecba59-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.141524 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.141506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12383791-0609-4007-9984-8e02d3ecba59-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.146339 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.146315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lqq\" (UniqueName: \"kubernetes.io/projected/12383791-0609-4007-9984-8e02d3ecba59-kube-api-access-t5lqq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv\" (UID: \"12383791-0609-4007-9984-8e02d3ecba59\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.296750 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.296719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" Jun 09 02:36:32.426984 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.426957 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv"] Jun 09 02:36:32.428444 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:36:32.428417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12383791_0609_4007_9984_8e02d3ecba59.slice/crio-b7689f9471327d5311bbdf857e97a2bd01eb7bd69eef45671cfde8e6779348bf WatchSource:0}: Error finding container b7689f9471327d5311bbdf857e97a2bd01eb7bd69eef45671cfde8e6779348bf: Status 404 returned error can't find the container with id b7689f9471327d5311bbdf857e97a2bd01eb7bd69eef45671cfde8e6779348bf Jun 09 02:36:32.864524 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.864485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" event={"ID":"12383791-0609-4007-9984-8e02d3ecba59","Type":"ContainerStarted","Data":"cb4d5294cb5195464394e89127ed0a5d41f452549784870b413458b96568c5db"} Jun 09 02:36:32.864908 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:32.864547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv" event={"ID":"12383791-0609-4007-9984-8e02d3ecba59","Type":"ContainerStarted","Data":"b7689f9471327d5311bbdf857e97a2bd01eb7bd69eef45671cfde8e6779348bf"} Jun 09 02:36:38.423487 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:38.423450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:38.423969 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:38.423510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:38.436188 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:38.436156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:38.901562 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:38.901536 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb" Jun 09 02:36:41.308610 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:41.308576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:36:41.309018 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:36:41.308851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:40:53.135629 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:40:53.135548 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv_12383791-0609-4007-9984-8e02d3ecba59/storage-initializer/0.log" Jun 09 02:40:58.542948 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:40:58.542916 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b97469585-kzlmv_44981372-5df2-487e-b23d-733275062959/nginx/0.log" Jun 09 02:40:59.434442 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:40:59.434414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f4c8f55c-7kvzl_aae96921-1270-4e02-a69d-a28b7ae4397d/copy-manifests/0.log" Jun 09 02:40:59.452930 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:40:59.452901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f4c8f55c-7kvzl_aae96921-1270-4e02-a69d-a28b7ae4397d/manager/0.log" Jun 09 02:41:01.013560 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:01.013529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qtz9z_fa79d061-01d9-40e4-be4c-f02f54ee6874/manager/0.log" Jun 09 02:41:01.464028 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:01.463990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7t8xq_151635b3-265a-4f6f-a746-0541c7a9fb39/manager/0.log" Jun 09 02:41:02.043647 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:02.043609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtl8q_1333c3e7-21d3-4dc6-88a0-a35b5df69d3a/istio-proxy/0.log" Jun 09 02:41:02.483133 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:02.483052 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/1.log" Jun 09 02:41:03.251250 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.251218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dtkhb_564a8c2b-a706-4983-b010-b2c9df973528/storage-initializer/0.log" Jun 09 02:41:03.258417 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.258390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dtkhb_564a8c2b-a706-4983-b010-b2c9df973528/main/0.log" Jun 09 02:41:03.365102 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.365078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2_3462c407-4793-4667-849c-326e8f41015b/storage-initializer/0.log" Jun 09 02:41:03.372596 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.372574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-2zkt2_3462c407-4793-4667-849c-326e8f41015b/main/0.log" Jun 09 02:41:03.479475 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.479452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb_673cb50f-59ca-41e0-a9bc-431ac336845a/storage-initializer/0.log" Jun 09 02:41:03.486851 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.486823 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgj7hb_673cb50f-59ca-41e0-a9bc-431ac336845a/main/0.log" Jun 09 02:41:03.588803 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:03.588764 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-lbpcv_12383791-0609-4007-9984-8e02d3ecba59/storage-initializer/0.log" Jun 09 02:41:10.312588 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:10.312553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6sv5q_8da81d0b-243e-478c-8f74-064a6c8a56b4/global-pull-secret-syncer/0.log" Jun 09 02:41:10.461568 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:10.461538 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9vvwc_8d5b1d7f-8fe9-40ae-a6d1-fc151817e377/konnectivity-agent/0.log" Jun 09 02:41:10.541853 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:10.541826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-26.ec2.internal_7b58dbed080db581ba525e909595b658/haproxy/0.log" Jun 09 02:41:14.887361 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:14.887327 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qtz9z_fa79d061-01d9-40e4-be4c-f02f54ee6874/manager/0.log" Jun 09 02:41:14.988301 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:14.988262 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7t8xq_151635b3-265a-4f6f-a746-0541c7a9fb39/manager/0.log" Jun 09 02:41:17.362068 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:17.362033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/node-exporter/0.log" Jun 09 02:41:17.384252 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:17.384228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/kube-rbac-proxy/0.log" Jun 09 02:41:17.410919 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:17.410896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtx9f_4d4d7aa8-8a06-4a57-a7b5-47315f92cfd1/init-textfile/0.log" Jun 09 02:41:21.658971 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.658936 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn"] Jun 09 02:41:21.662566 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.662544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.664817 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.664801 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vf9jd\"/\"kube-root-ca.crt\"" Jun 09 02:41:21.665645 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.665627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vf9jd\"/\"openshift-service-ca.crt\"" Jun 09 02:41:21.665708 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.665693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vf9jd\"/\"default-dockercfg-pmqq2\"" Jun 09 02:41:21.668384 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.668364 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn"] Jun 09 02:41:21.721957 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.721932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-podres\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.722078 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.721989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-lib-modules\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.722078 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.722050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-sys\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.722152 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.722077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-proc\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.722152 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.722109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqxr\" (UniqueName: \"kubernetes.io/projected/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-kube-api-access-kvqxr\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823309 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-proc\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823423 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqxr\" (UniqueName: \"kubernetes.io/projected/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-kube-api-access-kvqxr\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823423 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-podres\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823423 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-lib-modules\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823423 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-proc\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823570 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-sys\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823570 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-sys\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823570 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823522 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-podres\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.823570 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.823531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-lib-modules\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.830590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.830559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqxr\" (UniqueName: \"kubernetes.io/projected/f2010c54-90c9-4fa1-b4a3-573be9c47eb1-kube-api-access-kvqxr\") pod \"perf-node-gather-daemonset-k28fn\" (UID: \"f2010c54-90c9-4fa1-b4a3-573be9c47eb1\") " pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:21.973244 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:21.973179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:22.097546 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:22.097519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn"] Jun 09 02:41:22.100193 ip-10-0-138-26 kubenswrapper[2577]: W0609 02:41:22.100158 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf2010c54_90c9_4fa1_b4a3_573be9c47eb1.slice/crio-cd36f865fef05a326d6497f913174bcdae9be796ed1cea0282804b316e44f008 WatchSource:0}: Error finding container cd36f865fef05a326d6497f913174bcdae9be796ed1cea0282804b316e44f008: Status 404 returned error can't find the container with id cd36f865fef05a326d6497f913174bcdae9be796ed1cea0282804b316e44f008 Jun 09 02:41:22.175041 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:22.175016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" event={"ID":"f2010c54-90c9-4fa1-b4a3-573be9c47eb1","Type":"ContainerStarted","Data":"cd36f865fef05a326d6497f913174bcdae9be796ed1cea0282804b316e44f008"} Jun 09 02:41:22.902501 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:22.902471 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxpgm_c851bf2f-3504-4317-af6c-165888f67ebc/dns/0.log" Jun 09 02:41:22.919248 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:22.919223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gxpgm_c851bf2f-3504-4317-af6c-165888f67ebc/kube-rbac-proxy/0.log" Jun 09 02:41:22.978896 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:22.978870 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmvnh_f354c442-b9c3-49db-b1ee-c72040a0f38c/dns-node-resolver/0.log" Jun 09 02:41:23.187427 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:23.187341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" event={"ID":"f2010c54-90c9-4fa1-b4a3-573be9c47eb1","Type":"ContainerStarted","Data":"e27b4a373916e6980f238be52401fd543255a105af5d42b0bc1bc9e0c89c8d4a"} Jun 09 02:41:23.187593 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:23.187469 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:23.201665 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:23.201624 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" podStartSLOduration=2.201612014 podStartE2EDuration="2.201612014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 02:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 02:41:23.2007311 +0000 UTC m=+1182.363101345" watchObservedRunningTime="2026-06-09 02:41:23.201612014 +0000 UTC m=+1182.363982279" Jun 09 02:41:23.548008 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:23.547977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktspj_ef30b5e5-ab28-4ed4-98de-e3bf134130d1/node-ca/0.log" Jun 09 02:41:24.465033 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:24.464995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtl8q_1333c3e7-21d3-4dc6-88a0-a35b5df69d3a/istio-proxy/0.log" Jun 09 02:41:24.572159 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:24.572131 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/1.log" Jun 09 02:41:24.572928 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:24.572903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/0.log" Jun 09 02:41:25.253177 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:25.253147 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5x42p_6d58419f-147f-4c7f-a92f-14abf07f6b6a/serve-healthcheck-canary/0.log" Jun 09 02:41:25.895519 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:25.895491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xx6mr_bc88c0ef-5372-40ad-9f0d-4578321f754b/kube-rbac-proxy/0.log" Jun 09 02:41:25.913092 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:25.913069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xx6mr_bc88c0ef-5372-40ad-9f0d-4578321f754b/exporter/0.log" Jun 09 02:41:25.932343 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:25.932321 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xx6mr_bc88c0ef-5372-40ad-9f0d-4578321f754b/extractor/0.log" Jun 09 02:41:28.084986 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:28.084954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b97469585-kzlmv_44981372-5df2-487e-b23d-733275062959/nginx/0.log" Jun 09 02:41:28.353508 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:28.353426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f4c8f55c-7kvzl_aae96921-1270-4e02-a69d-a28b7ae4397d/manager/0.log" Jun 09 02:41:28.366788 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:28.366748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f4c8f55c-7kvzl_aae96921-1270-4e02-a69d-a28b7ae4397d/copy-manifests/0.log" Jun 09 02:41:29.203212 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:29.203180 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vf9jd/perf-node-gather-daemonset-k28fn" Jun 09 02:41:29.898614 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:29.898574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d95874d7-8bv8c_0e368ed1-237c-4702-a592-4ba232c0766d/manager/0.log" Jun 09 02:41:36.389065 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.389032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtl8q_1333c3e7-21d3-4dc6-88a0-a35b5df69d3a/istio-proxy/0.log" Jun 09 02:41:36.461877 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.461851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/1.log" Jun 09 02:41:36.462791 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.462751 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/0.log" Jun 09 02:41:36.785590 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.785565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/kube-multus-additional-cni-plugins/0.log" Jun 09 02:41:36.804024 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.804002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/egress-router-binary-copy/0.log" Jun 09 02:41:36.823503 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.823456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/cni-plugins/0.log" Jun 09 02:41:36.841338 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.841311 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/bond-cni-plugin/0.log" Jun 09 02:41:36.858650 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.858627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/routeoverride-cni/0.log" Jun 09 02:41:36.875554 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.875538 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/whereabouts-cni-bincopy/0.log" Jun 09 02:41:36.895434 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:36.895413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hkbk_2a5e0604-b335-411c-9874-c92dc2be2ef1/whereabouts-cni/0.log" Jun 09 02:41:37.215581 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.215512 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xmtlr_f068f487-04d2-41d8-945a-1a75dbe44b63/kube-multus/0.log" Jun 09 02:41:37.314662 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.314633 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvf66_53c8ff5a-405e-44f9-88a1-64b78ff78b25/network-metrics-daemon/0.log" Jun 09 02:41:37.330412 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.330385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qvf66_53c8ff5a-405e-44f9-88a1-64b78ff78b25/kube-rbac-proxy/0.log" Jun 09 02:41:37.417008 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.416978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtl8q_1333c3e7-21d3-4dc6-88a0-a35b5df69d3a/istio-proxy/0.log" Jun 09 02:41:37.501208 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.501127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/1.log" Jun 09 02:41:37.501743 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:37.501721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/0.log" Jun 09 02:41:38.479710 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.479674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-controller/0.log" Jun 09 02:41:38.497313 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.497286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/1.log" Jun 09 02:41:38.497450 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.497298 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovn-acl-logging/0.log" Jun 09 02:41:38.520153 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.520132 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/kube-rbac-proxy-node/0.log" Jun 09 02:41:38.542051 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.542031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 02:41:38.555750 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.555728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/northd/0.log" Jun 09 02:41:38.572532 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.572514 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/nbdb/0.log" Jun 09 02:41:38.591651 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.591637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/sbdb/0.log" Jun 09 02:41:38.647699 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:38.647675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cxm7c_ad862208-0b48-4ca7-8e96-a191b51a273c/ovnkube-controller/0.log" Jun 09 02:41:39.171126 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:39.171095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtl8q_1333c3e7-21d3-4dc6-88a0-a35b5df69d3a/istio-proxy/0.log" Jun 09 02:41:39.254049 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:39.254019 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/1.log" Jun 09 02:41:39.254629 ip-10-0-138-26 kubenswrapper[2577]: I0609 02:41:39.254610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-b2t8p_27958310-9457-401d-b75b-c8adae4cb996/istio-proxy/0.log"