Jun 10 20:39:17.617970 ip-10-0-139-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 20:39:17.617980 ip-10-0-139-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 20:39:17.617987 ip-10-0-139-104 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 20:39:17.618201 ip-10-0-139-104 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 20:39:27.632863 ip-10-0-139-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 20:39:27.632883 ip-10-0-139-104 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5176252d715a467a8194dff3b145a4d4 -- Jun 10 20:42:05.391125 ip-10-0-139-104 systemd[1]: Starting Kubernetes Kubelet... Jun 10 20:42:05.852090 ip-10-0-139-104 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:42:05.852090 ip-10-0-139-104 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 20:42:05.852090 ip-10-0-139-104 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:42:05.852090 ip-10-0-139-104 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 20:42:05.852090 ip-10-0-139-104 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:42:05.854401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.854314 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 20:42:05.859705 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859674 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.859705 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859706 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859710 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859713 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859716 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859720 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859723 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859726 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859728 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859731 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859734 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859736 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859739 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859744 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859749 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859752 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859755 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859758 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859760 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859763 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859766 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.859774 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859768 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859771 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859774 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859777 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859792 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859796 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859800 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859803 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859806 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859809 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859812 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859815 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859818 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859820 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859823 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859826 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859828 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859832 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859835 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.860263 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859838 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859840 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859842 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859845 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859847 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859850 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859852 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859855 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859857 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859860 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859862 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859864 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859867 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859869 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859872 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859876 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859878 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859881 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859885 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.860733 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859888 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859892 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859894 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859897 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859900 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859903 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859905 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859908 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859910 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859913 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859915 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859918 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859921 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859923 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859926 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859929 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859931 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859934 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859936 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859939 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.861235 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859941 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859944 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859946 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859949 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859951 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859954 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859957 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859960 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859963 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859966 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859968 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859971 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859974 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859976 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859979 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859982 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859984 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859987 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859989 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.859992 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860758 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.861721 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860765 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860768 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860771 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860773 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860781 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860784 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860787 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860789 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860792 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860794 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860797 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860799 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860802 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860805 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860808 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860810 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860812 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860815 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860818 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860821 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.862227 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860824 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860827 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860829 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860832 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860834 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860837 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860839 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860842 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860844 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860847 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860849 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860852 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860855 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860857 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860859 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860861 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860864 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860867 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860869 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860872 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.862740 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860874 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860878 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860882 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860885 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860888 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860890 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860893 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860895 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860898 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860900 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860903 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860906 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860909 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860911 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860915 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860917 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860920 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860922 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860925 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.863219 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860927 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860930 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860932 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860935 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860938 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860942 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860945 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860947 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860950 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860953 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860956 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860959 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860963 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860965 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860968 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860970 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860974 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860977 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860979 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.863711 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860982 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860985 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860988 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860991 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.860996 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861000 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861003 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861006 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861008 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861011 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861013 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861016 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861018 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861021 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861023 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861026 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861028 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861031 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861033 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861036 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.864193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861418 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861423 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861426 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861428 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861432 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861434 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861437 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861440 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861442 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861445 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861447 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861450 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861453 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861455 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861457 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861460 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861464 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861468 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861470 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861473 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.864696 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861476 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861478 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861481 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861484 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861486 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861488 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861491 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861493 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861496 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861499 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861501 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861504 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861506 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861509 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861511 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861514 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861516 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861519 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861522 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.865193 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861525 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861527 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861529 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861532 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861534 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861537 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861539 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861541 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861544 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861548 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861552 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861554 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861557 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861559 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861563 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861567 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861569 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861572 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861575 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861578 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.865655 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861580 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861583 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861586 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861588 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861591 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861595 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861598 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861600 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861602 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861605 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861608 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861611 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861614 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861616 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861620 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861623 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861626 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861628 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861631 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861633 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.866141 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861636 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861642 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861646 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861649 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861653 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861656 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861658 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861661 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861665 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861667 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861670 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861672 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861692 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861695 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861697 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861700 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861702 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861705 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861708 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.861711 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.866619 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861790 2582 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861797 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861804 2582 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861809 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861814 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861817 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861821 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861825 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861829 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861832 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861835 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861838 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861842 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861845 2582 flags.go:64] FLAG: --cgroup-root="" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861849 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861851 2582 flags.go:64] FLAG: --client-ca-file="" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861854 2582 flags.go:64] FLAG: --cloud-provider="external" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861857 2582 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861861 2582 flags.go:64] FLAG: --cluster-domain="" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861863 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861866 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861870 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861873 2582 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861877 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 20:42:05.867156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861880 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861883 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861886 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861890 2582 flags.go:64] FLAG: --contention-profiling="false" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861893 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861896 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861899 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861901 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861905 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861908 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861911 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861913 2582 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861916 2582 flags.go:64] FLAG: --enable-server="true" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861920 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861924 2582 flags.go:64] FLAG: --event-burst="100" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861927 2582 flags.go:64] FLAG: --event-qps="50" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861930 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861933 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861936 2582 flags.go:64] FLAG: --eviction-hard="" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861939 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861942 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861945 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861948 2582 flags.go:64] FLAG: --eviction-soft="" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861951 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861954 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 20:42:05.867763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861957 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861960 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861963 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861966 2582 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861969 2582 flags.go:64] FLAG: --feature-gates="" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861972 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861975 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861978 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861982 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861984 2582 flags.go:64] FLAG: --healthz-port="10248" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861987 2582 flags.go:64] FLAG: --help="false" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861990 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-139-104.ec2.internal" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861993 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861996 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.861998 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862002 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862005 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862008 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862011 2582 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862013 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862016 2582 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862020 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862023 2582 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862026 2582 flags.go:64] FLAG: --kube-reserved="" Jun 10 20:42:05.868401 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862029 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862031 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862034 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862037 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862040 2582 flags.go:64] FLAG: --lock-file="" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862043 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862046 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862050 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862055 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862058 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862061 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862063 2582 flags.go:64] FLAG: --logging-format="text" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862066 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862069 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862072 2582 flags.go:64] FLAG: --manifest-url="" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862074 2582 flags.go:64] FLAG: --manifest-url-header="" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862078 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862082 2582 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862086 2582 flags.go:64] FLAG: --max-pods="110" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862089 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862092 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862095 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862097 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862100 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862104 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 20:42:05.869044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862107 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862114 2582 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862117 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862119 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862122 2582 flags.go:64] FLAG: --pod-cidr="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862126 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862131 2582 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862134 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862136 2582 flags.go:64] FLAG: --pods-per-core="0" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862139 2582 flags.go:64] FLAG: --port="10250" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862142 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862145 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb8e7bcb6b91bb33" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862148 2582 flags.go:64] FLAG: --qos-reserved="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862152 2582 flags.go:64] FLAG: --read-only-port="10255" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862154 2582 flags.go:64] FLAG: --register-node="true" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862157 2582 flags.go:64] FLAG: --register-with-taints="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862161 2582 flags.go:64] FLAG: --registry-burst="10" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862163 2582 flags.go:64] FLAG: --registry-qps="5" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862166 2582 flags.go:64] FLAG: --reserved-cpus="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862168 2582 flags.go:64] FLAG: --reserved-memory="" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862176 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862179 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862182 2582 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862185 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862187 2582 flags.go:64] FLAG: --runonce="false" Jun 10 20:42:05.869726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862190 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862193 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862196 2582 flags.go:64] FLAG: --seccomp-default="false" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862198 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862201 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862204 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862207 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862210 2582 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862213 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862215 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862218 2582 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862220 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862223 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862226 2582 flags.go:64] FLAG: --system-cgroups="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862229 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862235 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862238 2582 flags.go:64] FLAG: --tls-cert-file="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862241 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862247 2582 flags.go:64] FLAG: --tls-min-version="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862251 2582 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862254 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862257 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862260 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862263 2582 flags.go:64] FLAG: --v="2" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862267 2582 flags.go:64] FLAG: --version="false" Jun 10 20:42:05.870374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862271 2582 flags.go:64] FLAG: --vmodule="" Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862274 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.862278 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862407 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862411 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862415 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862418 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862421 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862424 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862427 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862430 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862432 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862435 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862438 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862441 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862443 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862446 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862449 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862451 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862454 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.870987 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862456 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862461 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862465 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862467 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862470 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862473 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862477 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862480 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862482 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862485 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862487 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862490 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862493 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862495 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862498 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862500 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862502 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862505 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862508 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.871474 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862511 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862513 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862516 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862518 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862521 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862523 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862526 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862528 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862531 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862533 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862536 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862538 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862541 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862543 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862545 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862548 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862551 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862553 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862558 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862562 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.871965 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862564 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862567 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862569 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862572 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862575 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862577 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862580 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862582 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862584 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862587 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862590 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862592 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862594 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862597 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862599 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862602 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862604 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862607 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862609 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862612 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.872458 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862615 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862618 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862622 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862624 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862627 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862630 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862633 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862636 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862640 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862643 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862647 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862651 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862654 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862657 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862660 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862663 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862666 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862668 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862671 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.872966 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862673 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862692 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862695 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.862698 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.863450 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.870632 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.870767 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.871754 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.871762 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871824 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871829 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871833 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871836 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871840 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.873426 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871843 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871845 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871848 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871851 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871854 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871856 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871859 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871862 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871865 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871868 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871870 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871873 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871876 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871878 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871881 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871884 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871886 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871889 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871891 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871894 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.873860 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871897 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871899 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871901 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871904 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871907 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871910 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871914 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871917 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871920 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871922 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871925 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871927 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871930 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871933 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871936 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871940 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871943 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871945 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871950 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.874344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871953 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871957 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871960 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871963 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871966 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871969 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871972 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871975 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871977 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871980 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871983 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871985 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871987 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871990 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871993 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871995 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.871998 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872009 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872012 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872015 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.874855 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872018 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872021 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872023 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872026 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872029 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872031 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872034 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872036 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872039 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872041 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872043 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872046 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872048 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872051 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872054 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872057 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872059 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872061 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872064 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872067 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.875321 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872070 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872074 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872078 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872080 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872083 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872085 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872088 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872091 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872093 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872096 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872099 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872101 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872104 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872106 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872109 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.875856 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.872114 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872228 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872233 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872235 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872238 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872241 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872245 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872248 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872251 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872254 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872257 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872259 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872262 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872265 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872268 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872270 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872273 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872275 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872278 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:42:05.876282 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872281 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872284 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872286 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872289 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872293 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872295 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872298 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872300 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872303 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872305 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872308 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872310 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872313 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872315 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872317 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872320 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872322 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872325 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872327 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872329 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:42:05.876749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872332 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872334 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872336 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872339 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872341 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872344 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872347 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872349 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872351 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872354 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872357 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872359 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872362 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872364 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872367 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872369 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872371 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872374 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872377 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:42:05.877231 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872379 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872383 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872386 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872389 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872392 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872395 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872397 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872400 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872403 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872405 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872407 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872410 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872412 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872414 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872417 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872419 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872422 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872424 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872426 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:42:05.877807 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872429 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872432 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872434 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872436 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872439 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872442 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872444 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872446 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872449 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872451 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872454 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872456 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872458 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872461 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872464 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872467 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872469 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872472 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872474 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872477 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:42:05.878260 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872479 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872482 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:05.872484 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.872489 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.872610 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.875813 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.877374 2582 server.go:1019] "Starting client certificate rotation" Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.877506 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:42:05.878749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.877545 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:42:05.882172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.882146 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:42:05.887540 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.887517 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:42:05.895583 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.895564 2582 log.go:25] "Validated CRI v1 runtime API" Jun 10 20:42:05.899006 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.898989 2582 log.go:25] "Validated CRI v1 image API" Jun 10 20:42:05.900763 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.900747 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 20:42:05.903581 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.903560 2582 fs.go:135] Filesystem UUIDs: map[2ac5d5d7-7f95-4728-9c87-bb790717abca:/dev/nvme0n1p3 6d9adc42-9e1b-48c2-b01a-3a865b35462b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 20:42:05.903661 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.903580 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 20:42:05.908867 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.908752 2582 manager.go:216] Machine: {Timestamp:2026-06-10 20:42:05.907310332 +0000 UTC m=+0.376509201 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097805 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2099eafccb373031cfe6e263f03bf9 SystemUUID:ec2099ea-fccb-3730-31cf-e6e263f03bf9 BootID:5176252d-715a-467a-8194-dff3b145a4d4 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:a2:59:ae:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:a2:59:ae:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:6a:7c:a8:4b:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 20:42:05.908867 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.908862 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 20:42:05.908986 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.908943 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 20:42:05.910931 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.910913 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:42:05.912167 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.912136 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 20:42:05.912314 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.912171 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 20:42:05.912877 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.912866 2582 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 20:42:05.912919 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.912881 2582 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 20:42:05.912919 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.912889 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:42:05.913622 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.913612 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:42:05.914475 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.914465 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 20:42:05.917440 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917430 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:42:05.917560 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917551 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 20:42:05.917592 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917579 2582 kubelet.go:486] "Attempting to sync node with API server" Jun 10 20:42:05.917592 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917591 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 20:42:05.917645 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917605 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 20:42:05.917645 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917614 2582 kubelet.go:398] "Adding apiserver pod source" Jun 10 20:42:05.917645 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.917623 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 20:42:05.918122 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.918109 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:42:05.918166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.918136 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:42:05.921894 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.921876 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 20:42:05.923850 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.923836 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 20:42:05.923898 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.923868 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 20:42:05.925049 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925038 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 20:42:05.925083 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925056 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 20:42:05.925083 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925062 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 20:42:05.925083 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925068 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 20:42:05.925083 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925076 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 20:42:05.925083 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925084 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925100 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925106 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925112 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925117 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925125 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 20:42:05.925212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925130 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 20:42:05.926002 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.925990 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 20:42:05.926002 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.926002 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 20:42:05.929207 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.929194 2582 server.go:1268] "Started kubelet" Jun 10 20:42:05.933629 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.933522 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 20:42:05.933752 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.933668 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 20:42:05.934534 ip-10-0-139-104 systemd[1]: Started Kubernetes Kubelet. Jun 10 20:42:05.936409 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.934867 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 20:42:05.936409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.935005 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 20:42:05.936409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.935069 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 20:42:05.936409 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.935333 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 20:42:05.936409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.936168 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 20:42:05.938532 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.938517 2582 server.go:310] "Adding debug handlers to kubelet server" Jun 10 20:42:05.940760 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.940729 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8lnr" Jun 10 20:42:05.944132 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.942702 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-104.ec2.internal.18b7d2f4aae2d592 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-104.ec2.internal,UID:ip-10-0-139-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-104.ec2.internal,},FirstTimestamp:2026-06-10 20:42:05.929166226 +0000 UTC m=+0.398365077,LastTimestamp:2026-06-10 20:42:05.929166226 +0000 UTC m=+0.398365077,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-104.ec2.internal,}" Jun 10 20:42:05.945095 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945076 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 20:42:05.945180 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945103 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 20:42:05.945244 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.945199 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:05.945988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945752 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 20:42:05.945988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945765 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 20:42:05.945988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945766 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 20:42:05.945988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945826 2582 reconstruct.go:97] "Volume reconstruction finished" Jun 10 20:42:05.945988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.945833 2582 reconciler.go:29] "Reconciler: start to sync state" Jun 10 20:42:05.946873 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.946791 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 20:42:05.948238 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.948216 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p8lnr" Jun 10 20:42:05.948537 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.948519 2582 factory.go:55] Registering systemd factory Jun 10 20:42:05.948637 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.948541 2582 factory.go:223] Registration of the systemd container factory successfully Jun 10 20:42:05.949087 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949064 2582 factory.go:153] Registering CRI-O factory Jun 10 20:42:05.949087 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949083 2582 factory.go:223] Registration of the crio container factory successfully Jun 10 20:42:05.949245 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949141 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 20:42:05.949245 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949164 2582 factory.go:103] Registering Raw factory Jun 10 20:42:05.949245 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949180 2582 manager.go:1196] Started watching for new ooms in manager Jun 10 20:42:05.949646 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.949630 2582 manager.go:349] Starting recovery of all containers Jun 10 20:42:05.956800 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.956770 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:05.958493 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.958479 2582 manager.go:354] Recovery completed Jun 10 20:42:05.960228 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.959875 2582 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 20:42:05.963600 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.963584 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:05.965535 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.965519 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:05.965602 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.965548 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:05.965602 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.965558 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:05.966112 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:05.966093 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-104.ec2.internal\" not found" node="ip-10-0-139-104.ec2.internal" Jun 10 20:42:05.966168 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966157 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 20:42:05.966203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966168 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 20:42:05.966203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966185 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:42:05.966203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966187 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:05.966926 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966913 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:05.966982 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966937 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:05.966982 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.966948 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:05.967582 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.967571 2582 policy_none.go:49] "None policy: Start" Jun 10 20:42:05.967618 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.967586 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 20:42:05.967618 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.967598 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 20:42:05.968732 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:05.968720 2582 policy_none.go:47] "Start" Jun 10 20:42:06.012192 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.011352 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 20:42:06.012608 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.012591 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 20:42:06.012647 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.012629 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 20:42:06.012708 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.012652 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 20:42:06.012869 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.012846 2582 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 10 20:42:06.013567 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.013551 2582 manager.go:337] "Starting Device Plugin manager" Jun 10 20:42:06.013657 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.013594 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 20:42:06.013657 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.013607 2582 server.go:87] "Starting device plugin registration server" Jun 10 20:42:06.013943 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.013924 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 20:42:06.014029 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.013949 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 20:42:06.014201 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.014176 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 20:42:06.014283 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.014254 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 20:42:06.014283 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.014262 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 20:42:06.015918 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.015897 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 20:42:06.016044 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.015955 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.016044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.015988 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:06.113255 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.113153 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal"] Jun 10 20:42:06.113255 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.113254 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:06.114738 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.114721 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:06.116931 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116910 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:06.116931 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116926 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:06.117044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116945 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:06.117044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116959 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:06.117044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116977 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:06.117044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.117002 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.117044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.116960 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:06.118321 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.118309 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:06.118431 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.118417 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.118481 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.118447 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:06.119254 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119239 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:06.119317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119259 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:06.119317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119269 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:06.119317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119282 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:06.119317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119305 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:06.119317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.119315 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:06.120595 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.120581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.120653 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.120605 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:42:06.121289 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.121274 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:42:06.121352 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.121300 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:42:06.121352 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.121309 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:42:06.126087 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.126070 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.126165 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.126093 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-104.ec2.internal\": node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.141123 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.141106 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.155579 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.155561 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-104.ec2.internal\" not found" node="ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.160253 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.160238 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-104.ec2.internal\" not found" node="ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.241674 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.241649 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.246938 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.246919 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.247014 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.246957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.247067 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.247027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4735bec38b2ae745cdf385bb1d88877-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"b4735bec38b2ae745cdf385bb1d88877\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.342722 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.342650 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.347980 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.347958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4735bec38b2ae745cdf385bb1d88877-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"b4735bec38b2ae745cdf385bb1d88877\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.348061 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.347995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.348061 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.348013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.348157 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.348062 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.348157 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.348088 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4735bec38b2ae745cdf385bb1d88877-config\") pod \"kube-apiserver-proxy-ip-10-0-139-104.ec2.internal\" (UID: \"b4735bec38b2ae745cdf385bb1d88877\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.348157 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.348115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e3b5b307ee93d74b759aa9ff4dc4f68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal\" (UID: \"7e3b5b307ee93d74b759aa9ff4dc4f68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.443510 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.443416 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.459931 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.459908 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.466586 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.466568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:06.544362 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.544324 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.644824 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.644792 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.745337 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.745248 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.845707 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.845659 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.877064 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.877030 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 20:42:06.877726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.877190 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:42:06.877726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.877219 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:42:06.901041 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:06.901008 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3b5b307ee93d74b759aa9ff4dc4f68.slice/crio-62d146b27f98417c83b2d63cd05d200a9f7b53adc9498046eeda891409a4775b WatchSource:0}: Error finding container 62d146b27f98417c83b2d63cd05d200a9f7b53adc9498046eeda891409a4775b: Status 404 returned error can't find the container with id 62d146b27f98417c83b2d63cd05d200a9f7b53adc9498046eeda891409a4775b Jun 10 20:42:06.906744 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.906724 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:42:06.910344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:06.910183 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4735bec38b2ae745cdf385bb1d88877.slice/crio-251b0d59e44ebd18b3c194e5dbe2d5dc5f605bc05d48de96fd10aef16f34dbff WatchSource:0}: Error finding container 251b0d59e44ebd18b3c194e5dbe2d5dc5f605bc05d48de96fd10aef16f34dbff: Status 404 returned error can't find the container with id 251b0d59e44ebd18b3c194e5dbe2d5dc5f605bc05d48de96fd10aef16f34dbff Jun 10 20:42:06.946623 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:06.946592 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:06.950743 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.950713 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 20:37:05 +0000 UTC" deadline="2028-02-07 00:33:54.240115091 +0000 UTC" Jun 10 20:42:06.950743 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:06.950740 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14547h51m47.289378225s" Jun 10 20:42:07.017785 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.017668 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" event={"ID":"b4735bec38b2ae745cdf385bb1d88877","Type":"ContainerStarted","Data":"251b0d59e44ebd18b3c194e5dbe2d5dc5f605bc05d48de96fd10aef16f34dbff"} Jun 10 20:42:07.018753 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.018730 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"7e3b5b307ee93d74b759aa9ff4dc4f68","Type":"ContainerStarted","Data":"62d146b27f98417c83b2d63cd05d200a9f7b53adc9498046eeda891409a4775b"} Jun 10 20:42:07.047016 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:07.046981 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-104.ec2.internal\" not found" Jun 10 20:42:07.068047 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.068023 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:07.145322 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.145287 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" Jun 10 20:42:07.159007 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.158979 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:42:07.161321 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.161301 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" Jun 10 20:42:07.170578 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.170558 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:42:07.420173 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.419251 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:07.918189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.918105 2582 apiserver.go:52] "Watching apiserver" Jun 10 20:42:07.926484 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.926456 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 20:42:07.928314 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.928289 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ptt26","openshift-dns/node-resolver-p4f4d","openshift-multus/multus-additional-cni-plugins-r2d2x","openshift-multus/multus-vwqk5","openshift-ovn-kubernetes/ovnkube-node-94tqt","kube-system/global-pull-secret-syncer-bbbn9","kube-system/konnectivity-agent-jfb56","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t","openshift-image-registry/node-ca-vfl9p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal","openshift-multus/network-metrics-daemon-27dpd","openshift-network-diagnostics/network-check-target-45krw","openshift-network-operator/iptables-alerter-24xvn","kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal"] Jun 10 20:42:07.929672 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.929649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:07.930702 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.930660 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:07.931857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.931832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.932625 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.932607 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lxnkx\"" Jun 10 20:42:07.932768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.932656 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 20:42:07.932844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.932610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 20:42:07.933292 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.933035 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.933292 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.933088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.933697 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.933652 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.933820 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.933737 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r52jn\"" Jun 10 20:42:07.933899 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.933878 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 20:42:07.934626 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.934626 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934231 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.934957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934939 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 20:42:07.935036 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934985 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.935036 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934996 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dvgrh\"" Jun 10 20:42:07.935136 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934947 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 20:42:07.935136 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.934947 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 20:42:07.935475 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.935458 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 20:42:07.935952 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.935936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:07.936078 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:07.936029 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:07.936150 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.936091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czb9t\"" Jun 10 20:42:07.936339 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.936304 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 20:42:07.936869 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.936815 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.937230 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.937209 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:07.937316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.937241 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvv5n\"" Jun 10 20:42:07.937736 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.937717 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 20:42:07.937840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.937804 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 20:42:07.938264 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.938248 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 20:42:07.938452 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.938435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.939432 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.939118 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.940593 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.940573 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 20:42:07.940896 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.940877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.941140 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.941122 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4svjs\"" Jun 10 20:42:07.941348 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.941333 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.942390 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.942361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:07.944189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.943519 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.944189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.943544 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945070 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945142 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945156 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qcrvt\"" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945100 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2mtz\"" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945239 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:07.945425 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:07.945308 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:07.945748 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.945541 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 20:42:07.946424 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946404 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 20:42:07.946508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946480 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.946508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946485 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 20:42:07.946618 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946509 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:07.946618 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946549 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t5h7z\"" Jun 10 20:42:07.946618 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:07.946561 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:07.946758 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.946630 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 20:42:07.957257 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-socket-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.957374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-os-release\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.957374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-systemd-units\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-bin\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08af48b-0f73-4004-8330-217412b098bd-ovn-node-metrics-cert\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsn6h\" (UniqueName: \"kubernetes.io/projected/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-kube-api-access-tsn6h\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-registration-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-tmp\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-sys-fs\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-env-overrides\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957549 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-script-lib\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-cni-binary-copy\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957571 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9zp\" (UniqueName: \"kubernetes.io/projected/572b6584-7821-4c1c-bd36-5f7afab6d20f-kube-api-access-rq9zp\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-cnibin\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-config\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-multus-certs\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-conf\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2dst\" (UniqueName: \"kubernetes.io/projected/206e4f74-15a5-4585-a222-0f70726be05f-kube-api-access-z2dst\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-lib-modules\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.957854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a02cca1-add2-4bde-bded-7fb2b945fdfe-hosts-file\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957872 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-kubelet\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-var-lib-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957955 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.957992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-socket-dir-parent\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-netns\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958045 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-etc-kubernetes\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-sys\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958092 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958107 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/572b6584-7821-4c1c-bd36-5f7afab6d20f-host\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958136 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-829s9\" (UniqueName: \"kubernetes.io/projected/5c0524d1-7886-498b-9083-c3376b59e4eb-kube-api-access-829s9\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958160 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-konnectivity-ca\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958212 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8xr5\" (UniqueName: \"kubernetes.io/projected/670c03d7-8025-433f-9c0a-8204678691b1-kube-api-access-g8xr5\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958232 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.958274 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958292 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-netd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-multus-daemon-config\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-device-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958392 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-netns\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-ovn\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-var-lib-kubelet\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-slash\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-systemd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysconfig\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-etc-tuned\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gfg\" (UniqueName: \"kubernetes.io/projected/831dd800-8b87-40ae-9529-a2a129d6696d-kube-api-access-z8gfg\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.958822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-log-socket\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbzq\" (UniqueName: \"kubernetes.io/projected/f08af48b-0f73-4004-8330-217412b098bd-kube-api-access-vxbzq\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958812 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-cnibin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958836 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-multus\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-run\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-host\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-bin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-hostroot\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-conf-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.958996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp68\" (UniqueName: \"kubernetes.io/projected/7c27c771-6890-415f-b389-5de6663fc4fc-kube-api-access-zgp68\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-node-log\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-kubelet\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-modprobe-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959111 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-systemd\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670c03d7-8025-433f-9c0a-8204678691b1-iptables-alerter-script\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-os-release\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.959425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959189 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-kubelet-config\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-dbus\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-k8s-cni-cncf-io\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959266 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-agent-certs\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670c03d7-8025-433f-9c0a-8204678691b1-host-slash\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-kubernetes\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959372 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a02cca1-add2-4bde-bded-7fb2b945fdfe-tmp-dir\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-system-cni-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-etc-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-system-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/572b6584-7821-4c1c-bd36-5f7afab6d20f-serviceca\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:07.960166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.959470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gptc\" (UniqueName: \"kubernetes.io/projected/1a02cca1-add2-4bde-bded-7fb2b945fdfe-kube-api-access-2gptc\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:07.976027 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.976007 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9f4th" Jun 10 20:42:07.983935 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:07.983900 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9f4th" Jun 10 20:42:08.046886 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.046849 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 20:42:08.060790 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-etc-kubernetes\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-sys\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060814 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-etc-kubernetes\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/572b6584-7821-4c1c-bd36-5f7afab6d20f-host\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/572b6584-7821-4c1c-bd36-5f7afab6d20f-host\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-829s9\" (UniqueName: \"kubernetes.io/projected/5c0524d1-7886-498b-9083-c3376b59e4eb-kube-api-access-829s9\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-konnectivity-ca\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-sys\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8xr5\" (UniqueName: \"kubernetes.io/projected/670c03d7-8025-433f-9c0a-8204678691b1-kube-api-access-g8xr5\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.060957 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.060948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061124 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061285 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-netd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-multus-daemon-config\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061365 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-device-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061390 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-netns\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-ovn\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061436 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061459 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-var-lib-kubelet\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-slash\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-systemd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysconfig\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061596 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-konnectivity-ca\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-etc-tuned\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gfg\" (UniqueName: \"kubernetes.io/projected/831dd800-8b87-40ae-9529-a2a129d6696d-kube-api-access-z8gfg\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-log-socket\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbzq\" (UniqueName: \"kubernetes.io/projected/f08af48b-0f73-4004-8330-217412b098bd-kube-api-access-vxbzq\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061786 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-netns\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-cnibin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-device-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061829 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-ovn\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.061942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-multus\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061865 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysconfig\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-multus\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-run\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061916 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-var-lib-kubelet\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-slash\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061951 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-systemd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.061979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-host\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-bin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-host\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-hostroot\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-conf-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp68\" (UniqueName: \"kubernetes.io/projected/7c27c771-6890-415f-b389-5de6663fc4fc-kube-api-access-zgp68\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-node-log\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-kubelet\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-netd\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-modprobe-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.062844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-systemd\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670c03d7-8025-433f-9c0a-8204678691b1-iptables-alerter-script\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-os-release\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-kubelet-config\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-dbus\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062326 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-modprobe-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-k8s-cni-cncf-io\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-agent-certs\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062368 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-os-release\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062376 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-log-socket\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670c03d7-8025-433f-9c0a-8204678691b1-host-slash\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062416 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062411 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062421 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-systemd\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.063857 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.062307 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062458 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062463 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-kubernetes\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.062558 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:08.562512432 +0000 UTC m=+3.031711283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062565 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-kubernetes\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a02cca1-add2-4bde-bded-7fb2b945fdfe-tmp-dir\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-system-cni-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-etc-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062661 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-system-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/572b6584-7821-4c1c-bd36-5f7afab6d20f-serviceca\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670c03d7-8025-433f-9c0a-8204678691b1-host-slash\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062740 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062749 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gptc\" (UniqueName: \"kubernetes.io/projected/1a02cca1-add2-4bde-bded-7fb2b945fdfe-kube-api-access-2gptc\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-socket-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-os-release\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-systemd-units\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.064813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062838 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-bin\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062864 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08af48b-0f73-4004-8330-217412b098bd-ovn-node-metrics-cert\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsn6h\" (UniqueName: \"kubernetes.io/projected/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-kube-api-access-tsn6h\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-registration-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-tmp\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-sys-fs\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-env-overrides\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-script-lib\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062973 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670c03d7-8025-433f-9c0a-8204678691b1-iptables-alerter-script\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-cni-binary-copy\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062982 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-kubelet-config\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-conf-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063067 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-os-release\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063103 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-systemd-units\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063103 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27760ec5-855d-45f5-ac68-2397663005d0-dbus\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.062821 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-cnibin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9zp\" (UniqueName: \"kubernetes.io/projected/572b6584-7821-4c1c-bd36-5f7afab6d20f-kube-api-access-rq9zp\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.065604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-node-log\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-cni-bin\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-kubelet\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063273 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063279 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-multus-daemon-config\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063273 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-d\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063347 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-run\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/831dd800-8b87-40ae-9529-a2a129d6696d-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.063380 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063397 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-hostroot\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063437 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-socket-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.063451 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:08.5634359 +0000 UTC m=+3.032634738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-system-cni-dir\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-k8s-cni-cncf-io\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063472 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-var-lib-cni-bin\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063537 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-sys-fs\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.066324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c0524d1-7886-498b-9083-c3376b59e4eb-registration-dir\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a02cca1-add2-4bde-bded-7fb2b945fdfe-tmp-dir\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/572b6584-7821-4c1c-bd36-5f7afab6d20f-serviceca\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-etc-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.063987 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-system-cni-dir\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064066 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-script-lib\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064123 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-env-overrides\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-cnibin\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064165 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-config\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-multus-certs\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-conf\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064255 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/831dd800-8b87-40ae-9529-a2a129d6696d-cnibin\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064303 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-multus-certs\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064303 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2dst\" (UniqueName: \"kubernetes.io/projected/206e4f74-15a5-4585-a222-0f70726be05f-kube-api-access-z2dst\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-lib-modules\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a02cca1-add2-4bde-bded-7fb2b945fdfe-hosts-file\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064438 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/206e4f74-15a5-4585-a222-0f70726be05f-cni-binary-copy\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.067088 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-kubelet\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064545 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-lib-modules\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-var-lib-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064594 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-run-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-socket-dir-parent\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064642 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c27c771-6890-415f-b389-5de6663fc4fc-etc-sysctl-conf\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064660 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-netns\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a02cca1-add2-4bde-bded-7fb2b945fdfe-hosts-file\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064703 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-var-lib-openvswitch\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064711 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f08af48b-0f73-4004-8330-217412b098bd-host-kubelet\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064643 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f08af48b-0f73-4004-8330-217412b098bd-ovnkube-config\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-multus-socket-dir-parent\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.064756 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206e4f74-15a5-4585-a222-0f70726be05f-host-run-netns\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.066874 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-tmp\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.067022 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f08af48b-0f73-4004-8330-217412b098bd-ovn-node-metrics-cert\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.067099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cd3b208-0dfd-4c3a-8736-298a7c4b98d9-agent-certs\") pod \"konnectivity-agent-jfb56\" (UID: \"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9\") " pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:08.068025 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.067567 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c27c771-6890-415f-b389-5de6663fc4fc-etc-tuned\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.072628 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.072175 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-829s9\" (UniqueName: \"kubernetes.io/projected/5c0524d1-7886-498b-9083-c3376b59e4eb-kube-api-access-829s9\") pod \"aws-ebs-csi-driver-node-9nh7t\" (UID: \"5c0524d1-7886-498b-9083-c3376b59e4eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.072784 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.072662 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:08.072784 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.072704 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:08.072784 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.072719 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:08.072784 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.072779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:08.572759614 +0000 UTC m=+3.041958454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:08.072995 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.072799 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gptc\" (UniqueName: \"kubernetes.io/projected/1a02cca1-add2-4bde-bded-7fb2b945fdfe-kube-api-access-2gptc\") pod \"node-resolver-p4f4d\" (UID: \"1a02cca1-add2-4bde-bded-7fb2b945fdfe\") " pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.072995 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.072898 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8xr5\" (UniqueName: \"kubernetes.io/projected/670c03d7-8025-433f-9c0a-8204678691b1-kube-api-access-g8xr5\") pod \"iptables-alerter-24xvn\" (UID: \"670c03d7-8025-433f-9c0a-8204678691b1\") " pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.073504 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.073480 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp68\" (UniqueName: \"kubernetes.io/projected/7c27c771-6890-415f-b389-5de6663fc4fc-kube-api-access-zgp68\") pod \"tuned-ptt26\" (UID: \"7c27c771-6890-415f-b389-5de6663fc4fc\") " pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.074927 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.074906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9zp\" (UniqueName: \"kubernetes.io/projected/572b6584-7821-4c1c-bd36-5f7afab6d20f-kube-api-access-rq9zp\") pod \"node-ca-vfl9p\" (UID: \"572b6584-7821-4c1c-bd36-5f7afab6d20f\") " pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.075035 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.074959 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsn6h\" (UniqueName: \"kubernetes.io/projected/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-kube-api-access-tsn6h\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:08.075615 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.075587 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbzq\" (UniqueName: \"kubernetes.io/projected/f08af48b-0f73-4004-8330-217412b098bd-kube-api-access-vxbzq\") pod \"ovnkube-node-94tqt\" (UID: \"f08af48b-0f73-4004-8330-217412b098bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.075909 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.075876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2dst\" (UniqueName: \"kubernetes.io/projected/206e4f74-15a5-4585-a222-0f70726be05f-kube-api-access-z2dst\") pod \"multus-vwqk5\" (UID: \"206e4f74-15a5-4585-a222-0f70726be05f\") " pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.078337 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.078314 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gfg\" (UniqueName: \"kubernetes.io/projected/831dd800-8b87-40ae-9529-a2a129d6696d-kube-api-access-z8gfg\") pod \"multus-additional-cni-plugins-r2d2x\" (UID: \"831dd800-8b87-40ae-9529-a2a129d6696d\") " pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.247152 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.247029 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:08.254707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.254666 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-24xvn" Jun 10 20:42:08.263429 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.263406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" Jun 10 20:42:08.269270 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.269248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwqk5" Jun 10 20:42:08.275470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.275447 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:08.282208 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.282182 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfl9p" Jun 10 20:42:08.287627 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.287609 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptt26" Jun 10 20:42:08.294070 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.294049 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4f4d" Jun 10 20:42:08.299598 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.299578 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" Jun 10 20:42:08.327969 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.327932 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:08.376484 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.376455 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:08.567901 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.567802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:08.567901 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.567869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:08.568123 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.567963 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:08.568123 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.567999 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:08.568123 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.568039 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:09.56802087 +0000 UTC m=+4.037219714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:08.568123 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.568062 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:09.568052031 +0000 UTC m=+4.037250869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:08.669001 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.668959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:08.669182 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.669119 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:08.669182 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.669136 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:08.669182 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.669145 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:08.669332 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:08.669199 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:09.669184443 +0000 UTC m=+4.138383281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:08.825451 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.825353 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd3b208_0dfd_4c3a_8736_298a7c4b98d9.slice/crio-f77877c9f63ada5a50ba759f1a7a6ca33719ad6b3627a6968c8513ce81293559 WatchSource:0}: Error finding container f77877c9f63ada5a50ba759f1a7a6ca33719ad6b3627a6968c8513ce81293559: Status 404 returned error can't find the container with id f77877c9f63ada5a50ba759f1a7a6ca33719ad6b3627a6968c8513ce81293559 Jun 10 20:42:08.826385 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.826356 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206e4f74_15a5_4585_a222_0f70726be05f.slice/crio-10e698b9b9934d43d08cb68b0186092cd7dee18d996f4d3cc6465f4c5a8abf8c WatchSource:0}: Error finding container 10e698b9b9934d43d08cb68b0186092cd7dee18d996f4d3cc6465f4c5a8abf8c: Status 404 returned error can't find the container with id 10e698b9b9934d43d08cb68b0186092cd7dee18d996f4d3cc6465f4c5a8abf8c Jun 10 20:42:08.827353 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.827323 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572b6584_7821_4c1c_bd36_5f7afab6d20f.slice/crio-3999a0ab46b1b51444f89f0a573188b48bea8f31d4c2b25620ced2b72d8e6f13 WatchSource:0}: Error finding container 3999a0ab46b1b51444f89f0a573188b48bea8f31d4c2b25620ced2b72d8e6f13: Status 404 returned error can't find the container with id 3999a0ab46b1b51444f89f0a573188b48bea8f31d4c2b25620ced2b72d8e6f13 Jun 10 20:42:08.831534 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.831511 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831dd800_8b87_40ae_9529_a2a129d6696d.slice/crio-e7cacb810768e3ca53e25a326b8c6fe05bdff993873de07b2fc742806ac50b36 WatchSource:0}: Error finding container e7cacb810768e3ca53e25a326b8c6fe05bdff993873de07b2fc742806ac50b36: Status 404 returned error can't find the container with id e7cacb810768e3ca53e25a326b8c6fe05bdff993873de07b2fc742806ac50b36 Jun 10 20:42:08.832252 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.832233 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0524d1_7886_498b_9083_c3376b59e4eb.slice/crio-3a0ed0cd1f6b28b56a904aab55557081b0cd0c952fe21250a36af1ce988c1ac3 WatchSource:0}: Error finding container 3a0ed0cd1f6b28b56a904aab55557081b0cd0c952fe21250a36af1ce988c1ac3: Status 404 returned error can't find the container with id 3a0ed0cd1f6b28b56a904aab55557081b0cd0c952fe21250a36af1ce988c1ac3 Jun 10 20:42:08.833416 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.833318 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c27c771_6890_415f_b389_5de6663fc4fc.slice/crio-2e9f0e18429e2175548ad5c38893a1b372d8358079f1dc9740085ebbb1e54424 WatchSource:0}: Error finding container 2e9f0e18429e2175548ad5c38893a1b372d8358079f1dc9740085ebbb1e54424: Status 404 returned error can't find the container with id 2e9f0e18429e2175548ad5c38893a1b372d8358079f1dc9740085ebbb1e54424 Jun 10 20:42:08.834870 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.834843 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a02cca1_add2_4bde_bded_7fb2b945fdfe.slice/crio-4beaebf6d4690c571cd882cc46b297d71369d072f325504f2cf0b98915da7a61 WatchSource:0}: Error finding container 4beaebf6d4690c571cd882cc46b297d71369d072f325504f2cf0b98915da7a61: Status 404 returned error can't find the container with id 4beaebf6d4690c571cd882cc46b297d71369d072f325504f2cf0b98915da7a61 Jun 10 20:42:08.835762 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.835661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08af48b_0f73_4004_8330_217412b098bd.slice/crio-1664dd6aa9f32c3a1f6045870e9d9f29ae445afd1ff95d495289026ac0aa4d91 WatchSource:0}: Error finding container 1664dd6aa9f32c3a1f6045870e9d9f29ae445afd1ff95d495289026ac0aa4d91: Status 404 returned error can't find the container with id 1664dd6aa9f32c3a1f6045870e9d9f29ae445afd1ff95d495289026ac0aa4d91 Jun 10 20:42:08.837482 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:08.836443 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670c03d7_8025_433f_9c0a_8204678691b1.slice/crio-00cd2454f9fef37b426b17a9b41ce628a7eed4600c5974e18370c747a94441b3 WatchSource:0}: Error finding container 00cd2454f9fef37b426b17a9b41ce628a7eed4600c5974e18370c747a94441b3: Status 404 returned error can't find the container with id 00cd2454f9fef37b426b17a9b41ce628a7eed4600c5974e18370c747a94441b3 Jun 10 20:42:08.985989 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.985940 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:37:07 +0000 UTC" deadline="2027-12-17 17:51:55.890016357 +0000 UTC" Jun 10 20:42:08.985989 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:08.985984 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13317h9m46.904034914s" Jun 10 20:42:09.013259 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.013228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:09.013398 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.013342 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:09.013456 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.013390 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:09.013504 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.013484 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:09.023823 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.023784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" event={"ID":"b4735bec38b2ae745cdf385bb1d88877","Type":"ContainerStarted","Data":"8d06a9a7956aad82cd732f37f78aa53b8f23ae749bbf008dfa8e5902014cc682"} Jun 10 20:42:09.024862 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.024837 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerStarted","Data":"e7cacb810768e3ca53e25a326b8c6fe05bdff993873de07b2fc742806ac50b36"} Jun 10 20:42:09.025885 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.025866 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfl9p" event={"ID":"572b6584-7821-4c1c-bd36-5f7afab6d20f","Type":"ContainerStarted","Data":"3999a0ab46b1b51444f89f0a573188b48bea8f31d4c2b25620ced2b72d8e6f13"} Jun 10 20:42:09.026960 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.026931 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwqk5" event={"ID":"206e4f74-15a5-4585-a222-0f70726be05f","Type":"ContainerStarted","Data":"10e698b9b9934d43d08cb68b0186092cd7dee18d996f4d3cc6465f4c5a8abf8c"} Jun 10 20:42:09.027947 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.027929 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfb56" event={"ID":"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9","Type":"ContainerStarted","Data":"f77877c9f63ada5a50ba759f1a7a6ca33719ad6b3627a6968c8513ce81293559"} Jun 10 20:42:09.028940 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.028923 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" event={"ID":"5c0524d1-7886-498b-9083-c3376b59e4eb","Type":"ContainerStarted","Data":"3a0ed0cd1f6b28b56a904aab55557081b0cd0c952fe21250a36af1ce988c1ac3"} Jun 10 20:42:09.029772 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.029754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-24xvn" event={"ID":"670c03d7-8025-433f-9c0a-8204678691b1","Type":"ContainerStarted","Data":"00cd2454f9fef37b426b17a9b41ce628a7eed4600c5974e18370c747a94441b3"} Jun 10 20:42:09.030808 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.030775 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"1664dd6aa9f32c3a1f6045870e9d9f29ae445afd1ff95d495289026ac0aa4d91"} Jun 10 20:42:09.031843 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.031823 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptt26" event={"ID":"7c27c771-6890-415f-b389-5de6663fc4fc","Type":"ContainerStarted","Data":"2e9f0e18429e2175548ad5c38893a1b372d8358079f1dc9740085ebbb1e54424"} Jun 10 20:42:09.032754 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.032737 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4f4d" event={"ID":"1a02cca1-add2-4bde-bded-7fb2b945fdfe","Type":"ContainerStarted","Data":"4beaebf6d4690c571cd882cc46b297d71369d072f325504f2cf0b98915da7a61"} Jun 10 20:42:09.038948 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.038899 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-104.ec2.internal" podStartSLOduration=2.038885866 podStartE2EDuration="2.038885866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:09.038608009 +0000 UTC m=+3.507806868" watchObservedRunningTime="2026-06-10 20:42:09.038885866 +0000 UTC m=+3.508084726" Jun 10 20:42:09.576458 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.576370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:09.576458 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.576443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:09.576713 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.576566 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:09.576713 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.576630 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:11.576611301 +0000 UTC m=+6.045810144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:09.577058 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.577037 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:09.577150 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.577093 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:11.577077172 +0000 UTC m=+6.046276015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:09.677452 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.677412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:09.677658 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.677581 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:09.677658 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.677603 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:09.677658 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.677615 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:09.677867 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:09.677696 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:11.677658125 +0000 UTC m=+6.146856985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:09.986405 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.986294 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:37:07 +0000 UTC" deadline="2028-03-19 18:41:46.606987198 +0000 UTC" Jun 10 20:42:09.986405 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:09.986335 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15549h59m36.620657008s" Jun 10 20:42:10.016351 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:10.015775 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:10.016351 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:10.015912 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:10.054697 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:10.054646 2582 generic.go:356] "Generic (PLEG): container finished" podID="7e3b5b307ee93d74b759aa9ff4dc4f68" containerID="59ca82890239e39ff91e729279c89c9471a9f644cee2151bf5c5c77fb2e80f2d" exitCode=0 Jun 10 20:42:10.055655 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:10.055627 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"7e3b5b307ee93d74b759aa9ff4dc4f68","Type":"ContainerDied","Data":"59ca82890239e39ff91e729279c89c9471a9f644cee2151bf5c5c77fb2e80f2d"} Jun 10 20:42:11.013596 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.013555 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:11.014065 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.013670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:11.014065 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.013831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:11.014065 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.013957 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:11.066460 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.066424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" event={"ID":"7e3b5b307ee93d74b759aa9ff4dc4f68","Type":"ContainerStarted","Data":"0c1e8da84e5bc6083915a6b8cd4979a18d91eef6d9f0c910878343de2591b036"} Jun 10 20:42:11.085837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.085481 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-104.ec2.internal" podStartSLOduration=4.085460157 podStartE2EDuration="4.085460157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:11.084547225 +0000 UTC m=+5.553746084" watchObservedRunningTime="2026-06-10 20:42:11.085460157 +0000 UTC m=+5.554659018" Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.599847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.599912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.600035 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.600108 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:15.600089157 +0000 UTC m=+10.069287998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.600488 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:11.600625 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.600540 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:15.600525463 +0000 UTC m=+10.069724304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:11.701481 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:11.700881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:11.701481 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.701045 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:11.701481 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.701066 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:11.701481 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.701079 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:11.701481 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:11.701138 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:15.701120264 +0000 UTC m=+10.170319107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:12.016080 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:12.015540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:12.016080 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:12.015692 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:13.013419 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:13.013382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:13.013607 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:13.013537 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:13.013985 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:13.013930 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:13.014059 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:13.014028 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:14.013958 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:14.013918 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:14.014369 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:14.014044 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:15.012959 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:15.012918 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:15.013151 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.013027 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:15.013251 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:15.013223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:15.013407 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.013373 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:15.633707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:15.633651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:15.634082 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:15.633767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:15.634082 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.633897 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:15.634082 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.633963 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:23.633942285 +0000 UTC m=+18.103141138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:15.634358 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.634340 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:15.634419 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.634397 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:23.63438108 +0000 UTC m=+18.103579922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:15.734180 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:15.734129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:15.734353 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.734325 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:15.734353 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.734348 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:15.734448 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.734362 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:15.734448 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:15.734422 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:23.734402122 +0000 UTC m=+18.203600974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:16.014718 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:16.014329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:16.014718 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:16.014410 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:17.013502 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:17.013455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:17.013502 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:17.013501 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:17.014017 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:17.013591 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:17.014017 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:17.013710 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:18.013761 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:18.013726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:18.014148 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:18.013944 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:19.013105 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:19.013067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:19.013105 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:19.013092 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:19.013353 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:19.013204 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:19.013353 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:19.013330 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:20.013239 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:20.013203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:20.013724 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:20.013339 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:21.013147 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:21.013099 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:21.013147 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:21.013140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:21.013654 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:21.013248 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:21.013654 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:21.013390 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:22.013004 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:22.012972 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:22.013188 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:22.013095 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:23.013426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:23.013391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:23.013877 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.013545 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:23.013877 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:23.013570 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:23.013877 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.013665 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:23.689057 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:23.688975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:23.689057 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:23.689038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:23.689272 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.689138 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:23.689272 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.689145 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:23.689272 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.689206 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:39.689188653 +0000 UTC m=+34.158387510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:23.689272 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.689229 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:39.689217221 +0000 UTC m=+34.158416062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:23.789509 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:23.789466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:23.789719 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.789622 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:23.789719 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.789639 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:23.789719 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.789650 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:23.789878 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:23.789730 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:39.789713783 +0000 UTC m=+34.258912640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:24.013084 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:24.013043 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:24.013274 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:24.013177 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:25.013568 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:25.013527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:25.014087 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:25.013585 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:25.014087 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:25.013669 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:25.014087 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:25.013765 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:26.015844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:26.015805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:26.016200 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:26.015907 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:27.013392 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:27.013360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:27.013580 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:27.013405 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:27.013580 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:27.013504 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:27.013731 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:27.013625 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:28.015219 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.015191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:28.016092 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:28.015318 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:28.101424 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.101155 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptt26" event={"ID":"7c27c771-6890-415f-b389-5de6663fc4fc","Type":"ContainerStarted","Data":"aa17c6d57fa0225019dc0239265e53d747b63d33478246d25daf17cb9f182e3f"} Jun 10 20:42:28.103623 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.103581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4f4d" event={"ID":"1a02cca1-add2-4bde-bded-7fb2b945fdfe","Type":"ContainerStarted","Data":"430e3f9219132c9a3691f26a499befdb26c395ac07d43098569bc1829d43bce6"} Jun 10 20:42:28.104914 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.104889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerStarted","Data":"b81b8e0d34b70ee8bd763ed6995e5f846f5b9e3aab1591a8d1da532d0cb4ebbf"} Jun 10 20:42:28.107656 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.107628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfl9p" event={"ID":"572b6584-7821-4c1c-bd36-5f7afab6d20f","Type":"ContainerStarted","Data":"bdf80ffd6c1de487cc7864aac68cdca2ec41cf25980932bc3f9e1703470f0fad"} Jun 10 20:42:28.109258 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.109237 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwqk5" event={"ID":"206e4f74-15a5-4585-a222-0f70726be05f","Type":"ContainerStarted","Data":"1f14cb173a12f62c8820957b10f2508dacc5d651697b20cbd9e11fa560196a20"} Jun 10 20:42:28.110950 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.110809 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfb56" event={"ID":"5cd3b208-0dfd-4c3a-8736-298a7c4b98d9","Type":"ContainerStarted","Data":"476ac873b05af928a28f50a423dfd8794f02df62fcfb4e4785c1ef7c8f5cec41"} Jun 10 20:42:28.114255 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.113825 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" event={"ID":"5c0524d1-7886-498b-9083-c3376b59e4eb","Type":"ContainerStarted","Data":"51ef8ef0befe189178b8e1f6c48ea587b45a2bcd4af266ed092d3a4771c641b6"} Jun 10 20:42:28.116237 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.116215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"ece7bc878292a949bfcb34b6ffdac1d5382959b0410d2ab323bf6c3555f7d4e2"} Jun 10 20:42:28.121001 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.120963 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ptt26" podStartSLOduration=3.244180563 podStartE2EDuration="22.120937863s" totalImagesPullingTime="18.8767573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:28.120924679 +0000 UTC m=+22.590123539" watchObservedRunningTime="2026-06-10 20:42:28.120937863 +0000 UTC m=+22.590136715" Jun 10 20:42:28.161426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.161380 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vfl9p" podStartSLOduration=3.299820553 podStartE2EDuration="22.161363635s" totalImagesPullingTime="18.861543082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:28.161199547 +0000 UTC m=+22.630398409" watchObservedRunningTime="2026-06-10 20:42:28.161363635 +0000 UTC m=+22.630562493" Jun 10 20:42:28.176967 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.176920 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4f4d" podStartSLOduration=3.301989725 podStartE2EDuration="22.176905085s" totalImagesPullingTime="18.87491536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:28.176537408 +0000 UTC m=+22.645736291" watchObservedRunningTime="2026-06-10 20:42:28.176905085 +0000 UTC m=+22.646103943" Jun 10 20:42:28.198416 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.198365 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jfb56" podStartSLOduration=3.334608807 podStartE2EDuration="22.198349396s" totalImagesPullingTime="18.863740589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:28.197703884 +0000 UTC m=+22.666902737" watchObservedRunningTime="2026-06-10 20:42:28.198349396 +0000 UTC m=+22.667548254" Jun 10 20:42:28.218129 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:28.218066 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vwqk5" podStartSLOduration=3.317971135 podStartE2EDuration="22.218043949s" totalImagesPullingTime="18.900072814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:28.217119582 +0000 UTC m=+22.686318440" watchObservedRunningTime="2026-06-10 20:42:28.218043949 +0000 UTC m=+22.687242810" Jun 10 20:42:29.013422 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.013390 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:29.013583 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:29.013493 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:29.013583 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.013511 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:29.013712 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:29.013655 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:29.017780 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.017754 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 20:42:29.024658 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.024590 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T20:42:29.017769284Z","UUID":"112cde2e-785e-4d34-bc2a-0646fadb5c87","Handler":null,"Name":"","Endpoint":""} Jun 10 20:42:29.026119 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.026104 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 20:42:29.026210 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.026135 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 20:42:29.120757 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.120733 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:42:29.121054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121033 2582 generic.go:356] "Generic (PLEG): container finished" podID="f08af48b-0f73-4004-8330-217412b098bd" containerID="dacb0cbdfb226a3fcf4bd9634181eff2e8c53a9574fd7dc3a6cbb960f24cef74" exitCode=1 Jun 10 20:42:29.121166 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"fddf9505809f170697e91fd9920834b9b6465ea736c8bad47e16ae51b7aff274"} Jun 10 20:42:29.121284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"d11e870ed3cdede55bcfbd98bc2706839690b930df57f9f0ab5142db16d90e2f"} Jun 10 20:42:29.121284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121247 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"3da92574909a2e839526246c03f5d15ed2e56491cb2921ae965267b60c6f3510"} Jun 10 20:42:29.121386 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"3a3002e22210e72bf28ad380389d029719d0641c55f599323a77a9a86e934772"} Jun 10 20:42:29.121386 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.121374 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerDied","Data":"dacb0cbdfb226a3fcf4bd9634181eff2e8c53a9574fd7dc3a6cbb960f24cef74"} Jun 10 20:42:29.122606 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.122578 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="b81b8e0d34b70ee8bd763ed6995e5f846f5b9e3aab1591a8d1da532d0cb4ebbf" exitCode=0 Jun 10 20:42:29.122722 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.122661 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"b81b8e0d34b70ee8bd763ed6995e5f846f5b9e3aab1591a8d1da532d0cb4ebbf"} Jun 10 20:42:29.124722 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.124674 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" event={"ID":"5c0524d1-7886-498b-9083-c3376b59e4eb","Type":"ContainerStarted","Data":"2b7606256eba89c17b53b1ea585b2660ac89102c723c02eed430356c72230a08"} Jun 10 20:42:29.464915 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.464708 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:29.465398 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:29.465377 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:30.013109 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:30.013076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:30.013282 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:30.013207 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:30.128627 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:30.128595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-24xvn" event={"ID":"670c03d7-8025-433f-9c0a-8204678691b1","Type":"ContainerStarted","Data":"d0b022325d2bdeeec30484e631817805a6e639878d7dd6bf03e7effc38b6c67a"} Jun 10 20:42:30.129068 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:30.128839 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:30.129494 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:30.129475 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jfb56" Jun 10 20:42:30.168604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:30.168548 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-24xvn" podStartSLOduration=5.288324888 podStartE2EDuration="24.168527907s" totalImagesPullingTime="18.880203019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:30.147508891 +0000 UTC m=+24.616707749" watchObservedRunningTime="2026-06-10 20:42:30.168527907 +0000 UTC m=+24.637726767" Jun 10 20:42:31.013105 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:31.013067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:31.013105 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:31.013103 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:31.013311 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:31.013205 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:31.013361 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:31.013316 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:31.134432 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:31.134395 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" event={"ID":"5c0524d1-7886-498b-9083-c3376b59e4eb","Type":"ContainerStarted","Data":"365c88cac0ff7de9c86250a1da208c80274fb13b39c9a64080c6f7963864d789"} Jun 10 20:42:31.156891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:31.156822 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nh7t" podStartSLOduration=4.349524913 podStartE2EDuration="25.156801861s" totalImagesPullingTime="20.807276948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:31.156522132 +0000 UTC m=+25.625720985" watchObservedRunningTime="2026-06-10 20:42:31.156801861 +0000 UTC m=+25.626000723" Jun 10 20:42:32.013096 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:32.013060 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:32.013256 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:32.013202 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:32.140619 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:32.140589 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:42:32.141320 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:32.141062 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"0ce6fac4d889a586e637a4497d3b4cd136d83af3763860321afbee3cb7aaf62b"} Jun 10 20:42:33.012821 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:33.012793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:33.012942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:33.012793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:33.012942 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:33.012893 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:33.013067 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:33.012966 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:33.145412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:33.145377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerStarted","Data":"c946fda5894ae8c90b59fd7dffc583cdbd0636837edeaa190c40a84fe882279e"} Jun 10 20:42:34.016270 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.016088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:34.016515 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:34.016337 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:34.150967 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.150936 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:42:34.151409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.151314 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"ca6f5766d60b5a10a45a49b1617f3cfe454754dee244fecbd6dbbd1bc9e01c6d"} Jun 10 20:42:34.151587 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.151563 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:34.151805 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.151788 2582 scope.go:117] "RemoveContainer" containerID="dacb0cbdfb226a3fcf4bd9634181eff2e8c53a9574fd7dc3a6cbb960f24cef74" Jun 10 20:42:34.153261 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.153241 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="c946fda5894ae8c90b59fd7dffc583cdbd0636837edeaa190c40a84fe882279e" exitCode=0 Jun 10 20:42:34.153351 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.153281 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"c946fda5894ae8c90b59fd7dffc583cdbd0636837edeaa190c40a84fe882279e"} Jun 10 20:42:34.169821 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:34.169800 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:35.013356 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.013319 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:35.013519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.013334 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:35.013519 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:35.013451 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:35.013519 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:35.013495 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:35.161216 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.161157 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:42:35.161635 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.161608 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" event={"ID":"f08af48b-0f73-4004-8330-217412b098bd","Type":"ContainerStarted","Data":"a20b49acf8295673e735132677023bc68a5e77f02db09967de56cfef49e286fe"} Jun 10 20:42:35.161943 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.161911 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:35.162052 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.161996 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:35.164423 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.164394 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="8b2059480d48354331e7e787940cf399b042974f89975e1892eb9dfb13168410" exitCode=0 Jun 10 20:42:35.164543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.164441 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"8b2059480d48354331e7e787940cf399b042974f89975e1892eb9dfb13168410"} Jun 10 20:42:35.180751 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.180723 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:42:35.194564 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.194517 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" podStartSLOduration=10.048250014 podStartE2EDuration="29.194503084s" totalImagesPullingTime="19.14625307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:35.193038466 +0000 UTC m=+29.662237327" watchObservedRunningTime="2026-06-10 20:42:35.194503084 +0000 UTC m=+29.663701944" Jun 10 20:42:35.406944 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.406903 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27dpd"] Jun 10 20:42:35.407165 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.407051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:35.407251 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:35.407218 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:35.407508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.407489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45krw"] Jun 10 20:42:35.407725 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.407554 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:35.407725 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:35.407620 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:35.408687 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.408659 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbbn9"] Jun 10 20:42:35.408786 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:35.408773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:35.408885 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:35.408865 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:36.169042 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:36.169002 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="a09045bdafd2be40cb6ec30186e6121db1faa0510355933afb09dfb06bd82e4e" exitCode=0 Jun 10 20:42:36.169852 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:36.169085 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"a09045bdafd2be40cb6ec30186e6121db1faa0510355933afb09dfb06bd82e4e"} Jun 10 20:42:37.013876 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:37.013844 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:37.014050 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:37.013976 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:37.014341 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:37.014323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:37.014455 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:37.014435 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:37.014595 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:37.014512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:37.014595 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:37.014583 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:39.013038 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.013007 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:39.013638 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.013129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:39.013638 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.013148 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:42:39.013638 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.013167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:39.013638 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.013267 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45krw" podUID="51a45303-1878-42ce-a41c-0fb4491073f3" Jun 10 20:42:39.013638 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.013348 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbbn9" podUID="27760ec5-855d-45f5-ac68-2397663005d0" Jun 10 20:42:39.707080 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.707043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:39.707284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.707103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:39.707284 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.707238 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:39.707393 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.707296 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:39.707393 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.707312 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:11.707291665 +0000 UTC m=+66.176490507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:39.707393 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.707346 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret podName:27760ec5-855d-45f5-ac68-2397663005d0 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:11.707330475 +0000 UTC m=+66.176529312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret") pod "global-pull-secret-syncer-bbbn9" (UID: "27760ec5-855d-45f5-ac68-2397663005d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:39.807638 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:39.807608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:39.807800 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.807761 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:39.807800 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.807785 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:39.807800 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.807797 2582 projected.go:196] Error preparing data for projected volume kube-api-access-k8zm4 for pod openshift-network-diagnostics/network-check-target-45krw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:39.807922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:39.807852 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4 podName:51a45303-1878-42ce-a41c-0fb4491073f3 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:11.807838563 +0000 UTC m=+66.277037414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8zm4" (UniqueName: "kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4") pod "network-check-target-45krw" (UID: "51a45303-1878-42ce-a41c-0fb4491073f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:40.817592 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.817388 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-104.ec2.internal" event="NodeReady" Jun 10 20:42:40.818284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.817725 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 20:42:40.871361 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.871330 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sjnql"] Jun 10 20:42:40.902399 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.902369 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rvgdp"] Jun 10 20:42:40.902575 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.902513 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:40.905570 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.905548 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 20:42:40.905727 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.905695 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:42:40.905727 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.905700 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 20:42:40.918555 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.918528 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjnql"] Jun 10 20:42:40.918714 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.918589 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvgdp"] Jun 10 20:42:40.918714 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.918601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:40.921599 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.921574 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-822dd\"" Jun 10 20:42:40.921746 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.921650 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 20:42:40.922019 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.922001 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 20:42:40.922091 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:40.922055 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 20:42:41.013214 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.013186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:42:41.013363 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.013282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:42:41.013426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.013366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:42:41.015693 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88qb\" (UniqueName: \"kubernetes.io/projected/11f54219-2b12-41d2-9e0f-a98355d347ac-kube-api-access-c88qb\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.015794 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025d69db-7f09-45ce-919a-39dc16f9150e-config-volume\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.015847 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.015883 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f54219-2b12-41d2-9e0f-a98355d347ac-cert\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.015925 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025d69db-7f09-45ce-919a-39dc16f9150e-tmp-dir\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.015973 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.015931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdsgw\" (UniqueName: \"kubernetes.io/projected/025d69db-7f09-45ce-919a-39dc16f9150e-kube-api-access-gdsgw\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.016350 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:42:41.016442 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016418 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:42:41.016601 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016582 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:42:41.016653 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016588 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:42:41.016653 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016590 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:42:41.016771 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.016648 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:42:41.117235 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f54219-2b12-41d2-9e0f-a98355d347ac-cert\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.117235 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025d69db-7f09-45ce-919a-39dc16f9150e-tmp-dir\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.117235 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdsgw\" (UniqueName: \"kubernetes.io/projected/025d69db-7f09-45ce-919a-39dc16f9150e-kube-api-access-gdsgw\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.117437 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88qb\" (UniqueName: \"kubernetes.io/projected/11f54219-2b12-41d2-9e0f-a98355d347ac-kube-api-access-c88qb\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.117437 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117426 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025d69db-7f09-45ce-919a-39dc16f9150e-config-volume\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.117519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117488 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/025d69db-7f09-45ce-919a-39dc16f9150e-tmp-dir\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.117570 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.117531 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.117704 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:41.117652 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:41.117796 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:41.117785 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:41.617766902 +0000 UTC m=+36.086965739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:42:41.118033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.118004 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/025d69db-7f09-45ce-919a-39dc16f9150e-config-volume\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.121640 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.121622 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f54219-2b12-41d2-9e0f-a98355d347ac-cert\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.126826 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.126802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88qb\" (UniqueName: \"kubernetes.io/projected/11f54219-2b12-41d2-9e0f-a98355d347ac-kube-api-access-c88qb\") pod \"ingress-canary-rvgdp\" (UID: \"11f54219-2b12-41d2-9e0f-a98355d347ac\") " pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.127511 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.127491 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdsgw\" (UniqueName: \"kubernetes.io/projected/025d69db-7f09-45ce-919a-39dc16f9150e-kube-api-access-gdsgw\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.228355 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.228323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvgdp" Jun 10 20:42:41.569824 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.569794 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvgdp"] Jun 10 20:42:41.574296 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:41.574267 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f54219_2b12_41d2_9e0f_a98355d347ac.slice/crio-31f4b7805ade39bebf613affb10ea6db259dc5e0696e1936e2a8e81f20ac3b4a WatchSource:0}: Error finding container 31f4b7805ade39bebf613affb10ea6db259dc5e0696e1936e2a8e81f20ac3b4a: Status 404 returned error can't find the container with id 31f4b7805ade39bebf613affb10ea6db259dc5e0696e1936e2a8e81f20ac3b4a Jun 10 20:42:41.622611 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:41.622429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:41.622749 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:41.622594 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:41.622749 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:41.622696 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:42.622665463 +0000 UTC m=+37.091864300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:42:42.186757 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:42.186714 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvgdp" event={"ID":"11f54219-2b12-41d2-9e0f-a98355d347ac","Type":"ContainerStarted","Data":"31f4b7805ade39bebf613affb10ea6db259dc5e0696e1936e2a8e81f20ac3b4a"} Jun 10 20:42:42.190432 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:42.190398 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="b4b2f72f449f6a443f8e0c958348112eaa5204bed8f3f65afd4b48e8e3a3b264" exitCode=0 Jun 10 20:42:42.190557 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:42.190447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"b4b2f72f449f6a443f8e0c958348112eaa5204bed8f3f65afd4b48e8e3a3b264"} Jun 10 20:42:42.628645 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:42.628599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:42.628878 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:42.628734 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:42.628878 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:42.628813 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:44.628792816 +0000 UTC m=+39.097991657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:42:43.196666 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:43.196632 2582 generic.go:356] "Generic (PLEG): container finished" podID="831dd800-8b87-40ae-9529-a2a129d6696d" containerID="fefe377641ddb004c4cd7f6ecc3d72c3a6198ea190838c7c1495616a5978354e" exitCode=0 Jun 10 20:42:43.197105 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:43.196723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerDied","Data":"fefe377641ddb004c4cd7f6ecc3d72c3a6198ea190838c7c1495616a5978354e"} Jun 10 20:42:44.202712 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:44.202654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" event={"ID":"831dd800-8b87-40ae-9529-a2a129d6696d","Type":"ContainerStarted","Data":"4dfc194349b2babcaf72a6ef0ff229ae250427541a5b0d3ba02f93e0b8cb3538"} Jun 10 20:42:44.204234 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:44.204205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvgdp" event={"ID":"11f54219-2b12-41d2-9e0f-a98355d347ac","Type":"ContainerStarted","Data":"9f61056cd1ecc9fe3959f38320e695ebf8db04df2ab24b6827edfc86c8a1ee26"} Jun 10 20:42:44.228017 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:44.227949 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r2d2x" podStartSLOduration=8.999044828 podStartE2EDuration="38.227930855s" totalImagesPullingTime="29.228886027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:44.22765991 +0000 UTC m=+38.696858767" watchObservedRunningTime="2026-06-10 20:42:44.227930855 +0000 UTC m=+38.697129715" Jun 10 20:42:44.243516 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:44.243431 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rvgdp" podStartSLOduration=2.273835723 podStartE2EDuration="4.243412838s" totalImagesPullingTime="1.969577115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:44.243216339 +0000 UTC m=+38.712415210" watchObservedRunningTime="2026-06-10 20:42:44.243412838 +0000 UTC m=+38.712611697" Jun 10 20:42:44.644670 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:44.644588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:44.644844 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:44.644763 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:44.644844 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:44.644837 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:48.644819667 +0000 UTC m=+43.114018505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:42:47.154484 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.154453 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j"] Jun 10 20:42:47.190106 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.190076 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j"] Jun 10 20:42:47.190283 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.190167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.193597 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.193573 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 20:42:47.193745 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.193573 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 20:42:47.194796 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.194780 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 20:42:47.194862 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.194847 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 20:42:47.264070 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.264039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/539e0b33-e2ea-4622-a17e-204db8931b4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.264243 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.264091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539e0b33-e2ea-4622-a17e-204db8931b4d-tmp\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.264243 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.264132 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqjsd\" (UniqueName: \"kubernetes.io/projected/539e0b33-e2ea-4622-a17e-204db8931b4d-kube-api-access-vqjsd\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.365373 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.365340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/539e0b33-e2ea-4622-a17e-204db8931b4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.365548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.365397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539e0b33-e2ea-4622-a17e-204db8931b4d-tmp\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.365548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.365418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqjsd\" (UniqueName: \"kubernetes.io/projected/539e0b33-e2ea-4622-a17e-204db8931b4d-kube-api-access-vqjsd\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.365768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.365752 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539e0b33-e2ea-4622-a17e-204db8931b4d-tmp\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.369121 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.369089 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/539e0b33-e2ea-4622-a17e-204db8931b4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.373841 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.373823 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqjsd\" (UniqueName: \"kubernetes.io/projected/539e0b33-e2ea-4622-a17e-204db8931b4d-kube-api-access-vqjsd\") pod \"klusterlet-addon-workmgr-785b979b6c-4l95j\" (UID: \"539e0b33-e2ea-4622-a17e-204db8931b4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.500140 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.500095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:47.648814 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:47.648783 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j"] Jun 10 20:42:47.651924 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:42:47.651894 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539e0b33_e2ea_4622_a17e_204db8931b4d.slice/crio-5439e9046434ea4edb05af5c493be254091ab2bf96bd40af06f1705759e5c5a0 WatchSource:0}: Error finding container 5439e9046434ea4edb05af5c493be254091ab2bf96bd40af06f1705759e5c5a0: Status 404 returned error can't find the container with id 5439e9046434ea4edb05af5c493be254091ab2bf96bd40af06f1705759e5c5a0 Jun 10 20:42:48.213786 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:48.213749 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerStarted","Data":"5439e9046434ea4edb05af5c493be254091ab2bf96bd40af06f1705759e5c5a0"} Jun 10 20:42:48.676543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:48.676445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:48.676736 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:48.676638 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:48.676736 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:48.676709 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:56.676674459 +0000 UTC m=+51.145873297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:42:56.234192 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:56.234153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerStarted","Data":"4956419b9560053fe27238965f2855a1e6aea4eb011fb6ea608fbab245bdd5a7"} Jun 10 20:42:56.234622 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:56.234298 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:56.235955 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:56.235934 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:42:56.252240 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:56.252197 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" podStartSLOduration=1.308911648 podStartE2EDuration="9.252185061s" totalImagesPullingTime="7.943273413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:56.251985679 +0000 UTC m=+50.721184539" watchObservedRunningTime="2026-06-10 20:42:56.252185061 +0000 UTC m=+50.721383920" Jun 10 20:42:56.734307 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:42:56.734263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:42:56.734455 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:56.734423 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:56.734510 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:42:56.734492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:43:12.734474302 +0000 UTC m=+67.203673140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:43:07.182726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:07.182696 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94tqt" Jun 10 20:43:11.740397 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.740348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:43:11.740807 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.740436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:43:11.743400 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.743380 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:43:11.743448 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.743388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:43:11.751638 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:11.751611 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:43:11.751775 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:11.751763 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:44:15.751742626 +0000 UTC m=+130.220941466 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : secret "metrics-daemon-secret" not found Jun 10 20:43:11.753898 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.753878 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27760ec5-855d-45f5-ac68-2397663005d0-original-pull-secret\") pod \"global-pull-secret-syncer-bbbn9\" (UID: \"27760ec5-855d-45f5-ac68-2397663005d0\") " pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:43:11.841331 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.841279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:43:11.844223 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.844204 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:43:11.854045 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.854025 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:43:11.864783 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.864755 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zm4\" (UniqueName: \"kubernetes.io/projected/51a45303-1878-42ce-a41c-0fb4491073f3-kube-api-access-k8zm4\") pod \"network-check-target-45krw\" (UID: \"51a45303-1878-42ce-a41c-0fb4491073f3\") " pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:43:11.925871 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.925838 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:43:11.933333 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.933307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:43:11.933333 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:11.933323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbbn9" Jun 10 20:43:12.122320 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:12.122290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45krw"] Jun 10 20:43:12.124878 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:43:12.124852 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a45303_1878_42ce_a41c_0fb4491073f3.slice/crio-b15caf5337eaecedf03e7987f60a0bb6995fddfed01ba482c6b56971dfbf2c64 WatchSource:0}: Error finding container b15caf5337eaecedf03e7987f60a0bb6995fddfed01ba482c6b56971dfbf2c64: Status 404 returned error can't find the container with id b15caf5337eaecedf03e7987f60a0bb6995fddfed01ba482c6b56971dfbf2c64 Jun 10 20:43:12.137783 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:12.137758 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbbn9"] Jun 10 20:43:12.141143 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:43:12.141120 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27760ec5_855d_45f5_ac68_2397663005d0.slice/crio-c0e11271dfa509ef2c7d3b35a40bd3a1083bdf4a9166db9902477ed8a495c72d WatchSource:0}: Error finding container c0e11271dfa509ef2c7d3b35a40bd3a1083bdf4a9166db9902477ed8a495c72d: Status 404 returned error can't find the container with id c0e11271dfa509ef2c7d3b35a40bd3a1083bdf4a9166db9902477ed8a495c72d Jun 10 20:43:12.271864 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:12.271776 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45krw" event={"ID":"51a45303-1878-42ce-a41c-0fb4491073f3","Type":"ContainerStarted","Data":"b15caf5337eaecedf03e7987f60a0bb6995fddfed01ba482c6b56971dfbf2c64"} Jun 10 20:43:12.272874 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:12.272851 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbbn9" event={"ID":"27760ec5-855d-45f5-ac68-2397663005d0","Type":"ContainerStarted","Data":"c0e11271dfa509ef2c7d3b35a40bd3a1083bdf4a9166db9902477ed8a495c72d"} Jun 10 20:43:12.746697 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:12.746556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:43:12.747196 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:12.746757 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:12.747196 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:12.746855 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:43:44.74682443 +0000 UTC m=+99.216023281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:43:17.286814 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:17.286773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45krw" event={"ID":"51a45303-1878-42ce-a41c-0fb4491073f3","Type":"ContainerStarted","Data":"ee6749adb7edbb3cce476c58fd66d136e30b3ffe35114f64c701547b5e3d46e3"} Jun 10 20:43:17.287322 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:17.286888 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:43:17.288055 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:17.288032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbbn9" event={"ID":"27760ec5-855d-45f5-ac68-2397663005d0","Type":"ContainerStarted","Data":"9e46ca1937c5ad1d404f9c5de76a6063033bec1360cc2581ad5a4820c98ba42a"} Jun 10 20:43:17.322986 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:17.322928 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-45krw" podStartSLOduration=66.632759456 podStartE2EDuration="1m11.32291036s" totalImagesPullingTime="4.690150904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:17.306608218 +0000 UTC m=+71.775807076" watchObservedRunningTime="2026-06-10 20:43:17.32291036 +0000 UTC m=+71.792109214" Jun 10 20:43:17.323383 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:17.323352 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bbbn9" podStartSLOduration=66.645302062 podStartE2EDuration="1m11.323341447s" totalImagesPullingTime="4.678039385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:17.322750811 +0000 UTC m=+71.791949670" watchObservedRunningTime="2026-06-10 20:43:17.323341447 +0000 UTC m=+71.792540306" Jun 10 20:43:44.766536 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:44.766389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:43:44.767029 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:44.766544 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:44.767029 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:43:44.766609 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:44:48.766593008 +0000 UTC m=+163.235791845 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:43:48.293890 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:43:48.293857 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-45krw" Jun 10 20:44:15.773597 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:15.773557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:44:15.774101 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:15.773696 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:44:15.774101 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:15.773764 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs podName:bfe6db47-fd6e-499d-afc1-0f1f215bcb64 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:17.773749323 +0000 UTC m=+252.242948159 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs") pod "network-metrics-daemon-27dpd" (UID: "bfe6db47-fd6e-499d-afc1-0f1f215bcb64") : secret "metrics-daemon-secret" not found Jun 10 20:44:43.913383 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:43.913327 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sjnql" podUID="025d69db-7f09-45ce-919a-39dc16f9150e" Jun 10 20:44:44.028984 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:44.028945 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-27dpd" podUID="bfe6db47-fd6e-499d-afc1-0f1f215bcb64" Jun 10 20:44:44.499833 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:44.499804 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjnql" Jun 10 20:44:48.795001 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:48.794932 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:44:48.795406 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:48.795106 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:44:48.795406 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:44:48.795188 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls podName:025d69db-7f09-45ce-919a-39dc16f9150e nodeName:}" failed. No retries permitted until 2026-06-10 20:46:50.795171241 +0000 UTC m=+285.264370082 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls") pod "dns-default-sjnql" (UID: "025d69db-7f09-45ce-919a-39dc16f9150e") : secret "dns-default-metrics-tls" not found Jun 10 20:44:56.235718 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:56.235644 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" podUID="539e0b33-e2ea-4622-a17e-204db8931b4d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 10 20:44:56.528699 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:56.528591 2582 generic.go:356] "Generic (PLEG): container finished" podID="539e0b33-e2ea-4622-a17e-204db8931b4d" containerID="4956419b9560053fe27238965f2855a1e6aea4eb011fb6ea608fbab245bdd5a7" exitCode=1 Jun 10 20:44:56.528699 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:56.528651 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerDied","Data":"4956419b9560053fe27238965f2855a1e6aea4eb011fb6ea608fbab245bdd5a7"} Jun 10 20:44:56.528985 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:56.528972 2582 scope.go:117] "RemoveContainer" containerID="4956419b9560053fe27238965f2855a1e6aea4eb011fb6ea608fbab245bdd5a7" Jun 10 20:44:57.500421 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:57.500371 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:44:57.534047 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:57.534005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerStarted","Data":"a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799"} Jun 10 20:44:57.534231 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:57.534210 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:44:57.534768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:57.534752 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:44:59.013516 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:44:59.013477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:45:33.642785 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.642754 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl"] Jun 10 20:45:33.645548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.645533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" Jun 10 20:45:33.648670 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.648651 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7b2vv\"" Jun 10 20:45:33.649631 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.649606 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.650095 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.650079 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.665606 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.665577 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl"] Jun 10 20:45:33.718506 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.715831 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqkhn\" (UniqueName: \"kubernetes.io/projected/13b5f593-3f56-4c75-9087-8b5531764819-kube-api-access-pqkhn\") pod \"volume-data-source-validator-78dd696465-bnhpl\" (UID: \"13b5f593-3f56-4c75-9087-8b5531764819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" Jun 10 20:45:33.756698 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.756652 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl"] Jun 10 20:45:33.759675 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.759651 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69"] Jun 10 20:45:33.759817 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.759780 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.762231 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.762199 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"cluster-samples-operator-854f8b96b6-29xfl\" is forbidden: User \"system:node:ip-10-0-139-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-139-104.ec2.internal' and this object" podUID="e5d10c1b-83b5-4dac-9b70-48e9e617b061" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.762365 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.762274 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-657b964c49-c9kq9"] Jun 10 20:45:33.762441 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.762425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" Jun 10 20:45:33.762815 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.762790 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-samples-operator-dockercfg-hmgv9\" is forbidden: User \"system:node:ip-10-0-139-104.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-139-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hmgv9\"" type="*v1.Secret" Jun 10 20:45:33.762944 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.762829 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.763013 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.762998 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 20:45:33.763144 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.763130 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.765042 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.765025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.766760 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.766742 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cj4pl\"" Jun 10 20:45:33.771019 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.771005 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 20:45:33.771778 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.771757 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.772982 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.772915 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.773064 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.773020 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 20:45:33.773247 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.773227 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 20:45:33.773354 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.773236 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ml49q\"" Jun 10 20:45:33.773354 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.773327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 20:45:33.792988 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.792954 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl"] Jun 10 20:45:33.794486 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.794461 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69"] Jun 10 20:45:33.796218 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.796197 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-657b964c49-c9kq9"] Jun 10 20:45:33.816937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.816904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-stats-auth\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.816937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.816946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.817203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.816984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqkhn\" (UniqueName: \"kubernetes.io/projected/13b5f593-3f56-4c75-9087-8b5531764819-kube-api-access-pqkhn\") pod \"volume-data-source-validator-78dd696465-bnhpl\" (UID: \"13b5f593-3f56-4c75-9087-8b5531764819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" Jun 10 20:45:33.817203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817043 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4c8f\" (UniqueName: \"kubernetes.io/projected/fca55e88-563f-4ff3-9e42-9548b2550a81-kube-api-access-m4c8f\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.817203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cjs5\" (UniqueName: \"kubernetes.io/projected/e5d10c1b-83b5-4dac-9b70-48e9e617b061-kube-api-access-8cjs5\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.817203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-default-certificate\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.817203 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817145 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqcnj\" (UniqueName: \"kubernetes.io/projected/6fc107d0-ae2c-4819-b35c-f7cc4f20914c-kube-api-access-qqcnj\") pod \"network-check-source-dbd9cf844-w7x69\" (UID: \"6fc107d0-ae2c-4819-b35c-f7cc4f20914c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" Jun 10 20:45:33.817428 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.817428 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.817245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.838209 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.838174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqkhn\" (UniqueName: \"kubernetes.io/projected/13b5f593-3f56-4c75-9087-8b5531764819-kube-api-access-pqkhn\") pod \"volume-data-source-validator-78dd696465-bnhpl\" (UID: \"13b5f593-3f56-4c75-9087-8b5531764819\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" Jun 10 20:45:33.891850 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.891812 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:45:33.895125 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.895066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.910307 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.910282 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 20:45:33.910508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.910489 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-754v9\"" Jun 10 20:45:33.910576 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.910525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 20:45:33.910728 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.910710 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 20:45:33.916865 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.916845 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 20:45:33.917871 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cjs5\" (UniqueName: \"kubernetes.io/projected/e5d10c1b-83b5-4dac-9b70-48e9e617b061-kube-api-access-8cjs5\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.917917 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-default-certificate\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.917917 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqcnj\" (UniqueName: \"kubernetes.io/projected/6fc107d0-ae2c-4819-b35c-f7cc4f20914c-kube-api-access-qqcnj\") pod \"network-check-source-dbd9cf844-w7x69\" (UID: \"6fc107d0-ae2c-4819-b35c-f7cc4f20914c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" Jun 10 20:45:33.918033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.917996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918092 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-stats-auth\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.918203 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918212 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.918235 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.418215834 +0000 UTC m=+208.887414690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : configmap references non-existent config key: service-ca.crt Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.918274 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.918269 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.418247625 +0000 UTC m=+208.887446467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : secret "router-metrics-certs-default" not found Jun 10 20:45:33.918303 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:33.918300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls podName:e5d10c1b-83b5-4dac-9b70-48e9e617b061 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.418292517 +0000 UTC m=+208.887491354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-29xfl" (UID: "e5d10c1b-83b5-4dac-9b70-48e9e617b061") : secret "samples-operator-tls" not found Jun 10 20:45:33.918739 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4c8f\" (UniqueName: \"kubernetes.io/projected/fca55e88-563f-4ff3-9e42-9548b2550a81-kube-api-access-m4c8f\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.918739 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.918739 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.918397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7xc\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:33.920558 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.920537 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-default-certificate\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.920659 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.920642 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-stats-auth\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.928121 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.928099 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:45:33.945754 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.945723 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cjs5\" (UniqueName: \"kubernetes.io/projected/e5d10c1b-83b5-4dac-9b70-48e9e617b061-kube-api-access-8cjs5\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:33.945880 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.945777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4c8f\" (UniqueName: \"kubernetes.io/projected/fca55e88-563f-4ff3-9e42-9548b2550a81-kube-api-access-m4c8f\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:33.946865 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.946848 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqcnj\" (UniqueName: \"kubernetes.io/projected/6fc107d0-ae2c-4819-b35c-f7cc4f20914c-kube-api-access-qqcnj\") pod \"network-check-source-dbd9cf844-w7x69\" (UID: \"6fc107d0-ae2c-4819-b35c-f7cc4f20914c\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" Jun 10 20:45:33.954693 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:33.954644 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" Jun 10 20:45:34.019303 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019320 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7xc\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019426 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019470 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019834 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.019834 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.019578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.020504 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.020385 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.020504 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.020438 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.020504 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.020491 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:45:34.020504 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.020506 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dcb7c865c-l8bzd: secret "image-registry-tls" not found Jun 10 20:45:34.020749 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.020598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls podName:ad4b17e5-1006-45f6-8a22-935448964f0f nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.520577766 +0000 UTC m=+208.989776603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls") pod "image-registry-6dcb7c865c-l8bzd" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f") : secret "image-registry-tls" not found Jun 10 20:45:34.020749 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.020734 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.023156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.023122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.023268 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.023246 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.038384 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.038356 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7xc\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.043485 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.043459 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.076403 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.076367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" Jun 10 20:45:34.096579 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.096557 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl"] Jun 10 20:45:34.098563 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:45:34.098534 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b5f593_3f56_4c75_9087_8b5531764819.slice/crio-26aba6fbff07de32803cded46e462a159cafa0ada6b155b595c2ba3c81c4f635 WatchSource:0}: Error finding container 26aba6fbff07de32803cded46e462a159cafa0ada6b155b595c2ba3c81c4f635: Status 404 returned error can't find the container with id 26aba6fbff07de32803cded46e462a159cafa0ada6b155b595c2ba3c81c4f635 Jun 10 20:45:34.209140 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.209100 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69"] Jun 10 20:45:34.212819 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:45:34.212793 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc107d0_ae2c_4819_b35c_f7cc4f20914c.slice/crio-18ffccd349c533f55f89fc3463265af8ebab03661a808b3afd2cfd6c950fdeb7 WatchSource:0}: Error finding container 18ffccd349c533f55f89fc3463265af8ebab03661a808b3afd2cfd6c950fdeb7: Status 404 returned error can't find the container with id 18ffccd349c533f55f89fc3463265af8ebab03661a808b3afd2cfd6c950fdeb7 Jun 10 20:45:34.423310 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.423206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:34.423310 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.423248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:34.423310 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.423273 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:34.423565 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.423365 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:45:34.423565 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.423366 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:45:34.423565 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.423414 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.423394163 +0000 UTC m=+209.892593004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : configmap references non-existent config key: service-ca.crt Jun 10 20:45:34.423565 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.423439 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls podName:e5d10c1b-83b5-4dac-9b70-48e9e617b061 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.423430236 +0000 UTC m=+209.892629079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-29xfl" (UID: "e5d10c1b-83b5-4dac-9b70-48e9e617b061") : secret "samples-operator-tls" not found Jun 10 20:45:34.423565 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.423454 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.423446107 +0000 UTC m=+209.892644943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : secret "router-metrics-certs-default" not found Jun 10 20:45:34.524361 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.524321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:34.524537 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.524507 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:45:34.524537 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.524532 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dcb7c865c-l8bzd: secret "image-registry-tls" not found Jun 10 20:45:34.524606 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:34.524598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls podName:ad4b17e5-1006-45f6-8a22-935448964f0f nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.524578852 +0000 UTC m=+209.993777707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls") pod "image-registry-6dcb7c865c-l8bzd" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f") : secret "image-registry-tls" not found Jun 10 20:45:34.643696 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.643643 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" event={"ID":"13b5f593-3f56-4c75-9087-8b5531764819","Type":"ContainerStarted","Data":"26aba6fbff07de32803cded46e462a159cafa0ada6b155b595c2ba3c81c4f635"} Jun 10 20:45:34.645519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.645488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" event={"ID":"6fc107d0-ae2c-4819-b35c-f7cc4f20914c","Type":"ContainerStarted","Data":"364fe7250bb0cd15e075f8c4bc21b8ada14461179077fb4166c06955eab464dd"} Jun 10 20:45:34.645644 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.645535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" event={"ID":"6fc107d0-ae2c-4819-b35c-f7cc4f20914c","Type":"ContainerStarted","Data":"18ffccd349c533f55f89fc3463265af8ebab03661a808b3afd2cfd6c950fdeb7"} Jun 10 20:45:34.667266 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:34.667204 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-w7x69" podStartSLOduration=1.6671818919999999 podStartE2EDuration="1.667181892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:34.664940036 +0000 UTC m=+209.134138895" watchObservedRunningTime="2026-06-10 20:45:34.667181892 +0000 UTC m=+209.136380752" Jun 10 20:45:35.052284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.052255 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hmgv9\"" Jun 10 20:45:35.433706 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.433579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:35.433706 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.433643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:35.433706 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.433697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:35.433922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.433813 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.433793439 +0000 UTC m=+211.902992289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : configmap references non-existent config key: service-ca.crt Jun 10 20:45:35.433922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.433824 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:45:35.433922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.433813 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:45:35.433922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.433859 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.433850368 +0000 UTC m=+211.903049206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : secret "router-metrics-certs-default" not found Jun 10 20:45:35.433922 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.433873 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls podName:e5d10c1b-83b5-4dac-9b70-48e9e617b061 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.433865096 +0000 UTC m=+211.903063938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-29xfl" (UID: "e5d10c1b-83b5-4dac-9b70-48e9e617b061") : secret "samples-operator-tls" not found Jun 10 20:45:35.534187 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.534152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:35.534356 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.534302 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:45:35.534356 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.534319 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dcb7c865c-l8bzd: secret "image-registry-tls" not found Jun 10 20:45:35.534422 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:35.534369 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls podName:ad4b17e5-1006-45f6-8a22-935448964f0f nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.534354297 +0000 UTC m=+212.003553134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls") pod "image-registry-6dcb7c865c-l8bzd" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f") : secret "image-registry-tls" not found Jun 10 20:45:35.652966 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:35.652933 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" event={"ID":"13b5f593-3f56-4c75-9087-8b5531764819","Type":"ContainerStarted","Data":"5da373707ca0cfc186439b5cc25a0266bba1831c4fa55a64f9ec71858e9ac19f"} Jun 10 20:45:37.449199 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:37.449164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:37.449199 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:37.449203 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:37.449226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.449330 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.449342 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.449325579 +0000 UTC m=+215.918524416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : configmap references non-existent config key: service-ca.crt Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.449345 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.449378 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls podName:e5d10c1b-83b5-4dac-9b70-48e9e617b061 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.449366876 +0000 UTC m=+215.918565713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-29xfl" (UID: "e5d10c1b-83b5-4dac-9b70-48e9e617b061") : secret "samples-operator-tls" not found Jun 10 20:45:37.449701 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.449391 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.449385026 +0000 UTC m=+215.918583863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : secret "router-metrics-certs-default" not found Jun 10 20:45:37.550590 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:37.550549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:37.550782 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.550723 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:45:37.550782 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.550744 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dcb7c865c-l8bzd: secret "image-registry-tls" not found Jun 10 20:45:37.550857 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:37.550809 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls podName:ad4b17e5-1006-45f6-8a22-935448964f0f nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.550793736 +0000 UTC m=+216.019992572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls") pod "image-registry-6dcb7c865c-l8bzd" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f") : secret "image-registry-tls" not found Jun 10 20:45:41.482531 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:41.482473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:41.482531 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:41.482534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:41.482575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.482658 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.48263808 +0000 UTC m=+223.951836920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : configmap references non-existent config key: service-ca.crt Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.482713 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.482715 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.482764 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs podName:fca55e88-563f-4ff3-9e42-9548b2550a81 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.482752134 +0000 UTC m=+223.951950975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs") pod "router-default-657b964c49-c9kq9" (UID: "fca55e88-563f-4ff3-9e42-9548b2550a81") : secret "router-metrics-certs-default" not found Jun 10 20:45:41.483053 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.482885 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls podName:e5d10c1b-83b5-4dac-9b70-48e9e617b061 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.482865196 +0000 UTC m=+223.952064037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-29xfl" (UID: "e5d10c1b-83b5-4dac-9b70-48e9e617b061") : secret "samples-operator-tls" not found Jun 10 20:45:41.583451 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:41.583386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:41.583650 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.583563 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:45:41.583650 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.583582 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dcb7c865c-l8bzd: secret "image-registry-tls" not found Jun 10 20:45:41.583650 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:45:41.583640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls podName:ad4b17e5-1006-45f6-8a22-935448964f0f nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.583623739 +0000 UTC m=+224.052822577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls") pod "image-registry-6dcb7c865c-l8bzd" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f") : secret "image-registry-tls" not found Jun 10 20:45:42.177145 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:42.177117 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4f4d_1a02cca1-add2-4bde-bded-7fb2b945fdfe/dns-node-resolver/0.log" Jun 10 20:45:42.979837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:42.979808 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfl9p_572b6584-7821-4c1c-bd36-5f7afab6d20f/node-ca/0.log" Jun 10 20:45:43.976321 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:43.976290 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvgdp_11f54219-2b12-41d2-9e0f-a98355d347ac/serve-healthcheck-canary/0.log" Jun 10 20:45:49.550935 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.550894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:49.550935 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.550937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:49.551339 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.550961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:49.551590 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.551568 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca55e88-563f-4ff3-9e42-9548b2550a81-service-ca-bundle\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:49.553405 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.553378 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5d10c1b-83b5-4dac-9b70-48e9e617b061-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-29xfl\" (UID: \"e5d10c1b-83b5-4dac-9b70-48e9e617b061\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:49.553514 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.553411 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca55e88-563f-4ff3-9e42-9548b2550a81-metrics-certs\") pod \"router-default-657b964c49-c9kq9\" (UID: \"fca55e88-563f-4ff3-9e42-9548b2550a81\") " pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:49.652078 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.652046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:49.654564 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.654539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"image-registry-6dcb7c865c-l8bzd\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:49.669349 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.669311 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" Jun 10 20:45:49.681888 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.681864 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:49.804161 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.804074 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:49.810852 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.810800 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-bnhpl" podStartSLOduration=15.769588011 podStartE2EDuration="16.810775451s" totalImagesPullingTime="1.04118744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:35.672399253 +0000 UTC m=+210.141598112" watchObservedRunningTime="2026-06-10 20:45:49.810775451 +0000 UTC m=+224.279974312" Jun 10 20:45:49.811102 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.811085 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl"] Jun 10 20:45:49.833868 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.833837 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-657b964c49-c9kq9"] Jun 10 20:45:49.837757 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:45:49.837715 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca55e88_563f_4ff3_9e42_9548b2550a81.slice/crio-bd1b6c73ce6130208f61971d10aeb9d36242bdd36b4009f74b18645df0bae070 WatchSource:0}: Error finding container bd1b6c73ce6130208f61971d10aeb9d36242bdd36b4009f74b18645df0bae070: Status 404 returned error can't find the container with id bd1b6c73ce6130208f61971d10aeb9d36242bdd36b4009f74b18645df0bae070 Jun 10 20:45:49.950325 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:49.950288 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:45:49.953093 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:45:49.953064 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4b17e5_1006_45f6_8a22_935448964f0f.slice/crio-21ce0503c2226f8cb5d4f592d14d7b717dad2c6ecdaf7aa6b74354e0926b9f1d WatchSource:0}: Error finding container 21ce0503c2226f8cb5d4f592d14d7b717dad2c6ecdaf7aa6b74354e0926b9f1d: Status 404 returned error can't find the container with id 21ce0503c2226f8cb5d4f592d14d7b717dad2c6ecdaf7aa6b74354e0926b9f1d Jun 10 20:45:50.698955 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.698917 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" event={"ID":"ad4b17e5-1006-45f6-8a22-935448964f0f","Type":"ContainerStarted","Data":"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8"} Jun 10 20:45:50.699412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.699081 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:45:50.699412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.699123 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" event={"ID":"ad4b17e5-1006-45f6-8a22-935448964f0f","Type":"ContainerStarted","Data":"21ce0503c2226f8cb5d4f592d14d7b717dad2c6ecdaf7aa6b74354e0926b9f1d"} Jun 10 20:45:50.700605 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.700572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-657b964c49-c9kq9" event={"ID":"fca55e88-563f-4ff3-9e42-9548b2550a81","Type":"ContainerStarted","Data":"46ac87687881f6c36cebded4af97512a57458034865c1e721bcb2eab5fd3bbe7"} Jun 10 20:45:50.700759 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.700619 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-657b964c49-c9kq9" event={"ID":"fca55e88-563f-4ff3-9e42-9548b2550a81","Type":"ContainerStarted","Data":"bd1b6c73ce6130208f61971d10aeb9d36242bdd36b4009f74b18645df0bae070"} Jun 10 20:45:50.701777 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.701755 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" event={"ID":"e5d10c1b-83b5-4dac-9b70-48e9e617b061","Type":"ContainerStarted","Data":"8ce4f491850e093ed214fc99ba852c19842f74d694f93adb9a7062bb208ee0c1"} Jun 10 20:45:50.723101 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.723052 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" podStartSLOduration=17.723031195 podStartE2EDuration="17.723031195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:50.719533778 +0000 UTC m=+225.188732649" watchObservedRunningTime="2026-06-10 20:45:50.723031195 +0000 UTC m=+225.192230032" Jun 10 20:45:50.739122 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:50.739063 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-657b964c49-c9kq9" podStartSLOduration=17.739048672 podStartE2EDuration="17.739048672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:50.738202119 +0000 UTC m=+225.207400982" watchObservedRunningTime="2026-06-10 20:45:50.739048672 +0000 UTC m=+225.208247531" Jun 10 20:45:51.682871 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:51.682836 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:51.685813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:51.685788 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:51.705738 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:51.705715 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:51.707501 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:51.707477 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-657b964c49-c9kq9" Jun 10 20:45:52.710345 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:52.710307 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" event={"ID":"e5d10c1b-83b5-4dac-9b70-48e9e617b061","Type":"ContainerStarted","Data":"f6201077a700419a068325bd180ca2bb2f10f48deef63c69ce544d7f212cf55a"} Jun 10 20:45:52.710778 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:52.710371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" event={"ID":"e5d10c1b-83b5-4dac-9b70-48e9e617b061","Type":"ContainerStarted","Data":"6ae2e1f133939d6cfc90b6ab987e4342d4aa50d8bbe239d3a753df71a4e60dcd"} Jun 10 20:45:52.729014 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:45:52.728957 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-29xfl" podStartSLOduration=17.678483509 podStartE2EDuration="19.728937814s" totalImagesPullingTime="2.050454305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:52.727962107 +0000 UTC m=+227.197160967" watchObservedRunningTime="2026-06-10 20:45:52.728937814 +0000 UTC m=+227.198136673" Jun 10 20:46:03.722380 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.722345 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mpnkg"] Jun 10 20:46:03.727036 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.727017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.729428 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.729404 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 20:46:03.729595 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.729579 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 20:46:03.730758 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.730738 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzswp\"" Jun 10 20:46:03.730758 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.730744 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 20:46:03.730928 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.730785 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 20:46:03.741197 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.741174 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mpnkg"] Jun 10 20:46:03.783995 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.783966 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:46:03.865553 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.865513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.865750 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.865572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsl7g\" (UniqueName: \"kubernetes.io/projected/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-api-access-rsl7g\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.865750 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.865655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-crio-socket\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.865750 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.865711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-data-volume\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.865871 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.865750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966467 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966467 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsl7g\" (UniqueName: \"kubernetes.io/projected/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-api-access-rsl7g\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-crio-socket\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966650 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-crio-socket\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.966817 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.966720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-data-volume\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.967087 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.967065 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-data-volume\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.967205 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.967128 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.969044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.969029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:03.975119 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:03.975068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsl7g\" (UniqueName: \"kubernetes.io/projected/650b0f52-3cd1-4c3f-b423-e9eb5235fa3d-kube-api-access-rsl7g\") pod \"insights-runtime-extractor-mpnkg\" (UID: \"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d\") " pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:04.036269 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:04.036222 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mpnkg" Jun 10 20:46:04.163435 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:04.163401 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mpnkg"] Jun 10 20:46:04.167573 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:04.167535 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650b0f52_3cd1_4c3f_b423_e9eb5235fa3d.slice/crio-72aadebee6ec459e1ed5ea6505d1cbb95b8e15f53813edf673256627cd3cfb54 WatchSource:0}: Error finding container 72aadebee6ec459e1ed5ea6505d1cbb95b8e15f53813edf673256627cd3cfb54: Status 404 returned error can't find the container with id 72aadebee6ec459e1ed5ea6505d1cbb95b8e15f53813edf673256627cd3cfb54 Jun 10 20:46:04.749880 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:04.749845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpnkg" event={"ID":"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d","Type":"ContainerStarted","Data":"91addeb752b41e862a3b4511457b695a40e832f84505c8e90d01771390e13703"} Jun 10 20:46:04.750307 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:04.749900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpnkg" event={"ID":"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d","Type":"ContainerStarted","Data":"72aadebee6ec459e1ed5ea6505d1cbb95b8e15f53813edf673256627cd3cfb54"} Jun 10 20:46:05.755141 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:05.755102 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpnkg" event={"ID":"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d","Type":"ContainerStarted","Data":"bc8a7add03a05798eb7a35bceadbb0e67fd482ad4fe1a8047fd7208a1568473c"} Jun 10 20:46:06.760493 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:06.760455 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mpnkg" event={"ID":"650b0f52-3cd1-4c3f-b423-e9eb5235fa3d","Type":"ContainerStarted","Data":"386ec6884e1874b84c9ad3f0165d637b09a1a438e00ffb04de30750de8f8e973"} Jun 10 20:46:06.780376 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:06.780320 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mpnkg" podStartSLOduration=1.864815198 podStartE2EDuration="3.780305889s" totalImagesPullingTime="1.915490691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:06.779056428 +0000 UTC m=+241.248255327" watchObservedRunningTime="2026-06-10 20:46:06.780305889 +0000 UTC m=+241.249504748" Jun 10 20:46:08.825910 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:08.825878 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx"] Jun 10 20:46:08.829132 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:08.829115 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:08.831786 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:08.831753 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 20:46:08.831786 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:08.831756 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k4qrh\"" Jun 10 20:46:08.836823 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:08.836799 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx"] Jun 10 20:46:09.013731 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.013666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6crx\" (UID: \"20b3c7aa-5ac8-4078-a796-3417a175e333\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:09.114572 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.114480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6crx\" (UID: \"20b3c7aa-5ac8-4078-a796-3417a175e333\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:09.114742 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:09.114642 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 20:46:09.114742 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:09.114740 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates podName:20b3c7aa-5ac8-4078-a796-3417a175e333 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:09.614719263 +0000 UTC m=+244.083918120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-t6crx" (UID: "20b3c7aa-5ac8-4078-a796-3417a175e333") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 20:46:09.617726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.617667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6crx\" (UID: \"20b3c7aa-5ac8-4078-a796-3417a175e333\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:09.620261 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.620235 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20b3c7aa-5ac8-4078-a796-3417a175e333-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-t6crx\" (UID: \"20b3c7aa-5ac8-4078-a796-3417a175e333\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:09.738838 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.738801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:09.866531 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:09.866501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx"] Jun 10 20:46:09.869358 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:09.869286 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b3c7aa_5ac8_4078_a796_3417a175e333.slice/crio-40569aeaac01eeb5849d37270c036b12ed95be0af229f8df0b483260a5772d7f WatchSource:0}: Error finding container 40569aeaac01eeb5849d37270c036b12ed95be0af229f8df0b483260a5772d7f: Status 404 returned error can't find the container with id 40569aeaac01eeb5849d37270c036b12ed95be0af229f8df0b483260a5772d7f Jun 10 20:46:10.775081 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:10.775042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" event={"ID":"20b3c7aa-5ac8-4078-a796-3417a175e333","Type":"ContainerStarted","Data":"40569aeaac01eeb5849d37270c036b12ed95be0af229f8df0b483260a5772d7f"} Jun 10 20:46:11.779316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:11.779283 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" event={"ID":"20b3c7aa-5ac8-4078-a796-3417a175e333","Type":"ContainerStarted","Data":"dc94a0c957c5da01b4135e7353271d4be8df5b608d514b0cfce0daeb86a485c4"} Jun 10 20:46:11.779740 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:11.779578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:11.786245 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:11.786217 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" Jun 10 20:46:11.798724 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:11.798650 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-t6crx" podStartSLOduration=2.732828969 podStartE2EDuration="3.798636795s" totalImagesPullingTime="1.065807826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:11.797568345 +0000 UTC m=+246.266767204" watchObservedRunningTime="2026-06-10 20:46:11.798636795 +0000 UTC m=+246.267835654" Jun 10 20:46:12.888030 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.887993 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n"] Jun 10 20:46:12.891037 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.891019 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:12.893526 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.893507 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 20:46:12.894980 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.894962 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 20:46:12.895079 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.895004 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 20:46:12.895079 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.894968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 20:46:12.895079 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.894971 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sjvsb\"" Jun 10 20:46:12.895239 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.894968 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 20:46:12.900377 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:12.900353 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n"] Jun 10 20:46:13.046068 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.046034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.046068 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.046071 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8rcq\" (UniqueName: \"kubernetes.io/projected/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-kube-api-access-m8rcq\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.046309 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.046119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.046309 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.046162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.146756 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.146642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.146756 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.146696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8rcq\" (UniqueName: \"kubernetes.io/projected/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-kube-api-access-m8rcq\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.146756 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.146738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.147020 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.146760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.147020 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:13.146806 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 20:46:13.147020 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:13.146897 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls podName:9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:13.646873157 +0000 UTC m=+248.116071994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-xsn6n" (UID: "9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5") : secret "prometheus-operator-tls" not found Jun 10 20:46:13.147426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.147409 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.149268 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.149251 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.156656 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.156631 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8rcq\" (UniqueName: \"kubernetes.io/projected/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-kube-api-access-m8rcq\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.412583 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.412500 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:13.415690 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.415665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.419539 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419518 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 20:46:13.419669 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419555 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 20:46:13.419669 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d7cfp\"" Jun 10 20:46:13.419802 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419696 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 20:46:13.419882 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 20:46:13.419882 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419874 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 20:46:13.420002 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419893 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 20:46:13.420002 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.419898 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 20:46:13.424726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.424705 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 20:46:13.426168 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.426146 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:13.449666 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.449831 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.449831 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449744 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.449831 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.449831 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.449831 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xd8\" (UniqueName: \"kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.450021 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.449850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.550891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.550854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.550922 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.550948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xd8\" (UniqueName: \"kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.550982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551252 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551252 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551748 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551748 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551741 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.551891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.551757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.552282 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.552259 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.553517 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.553494 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.553646 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.553630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.559345 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.559316 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xd8\" (UniqueName: \"kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8\") pod \"console-5c9554c8bc-494w7\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.651671 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.651635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.654104 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.654085 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xsn6n\" (UID: \"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.725869 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.725828 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:13.790793 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.790753 2582 patch_prober.go:28] interesting pod/image-registry-6dcb7c865c-l8bzd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:13.790967 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.790866 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:13.799797 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.799771 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" Jun 10 20:46:13.860086 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.860040 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:13.864450 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:13.864423 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89bbb819_6add_4757_a8ea_0a1d0a59d30f.slice/crio-341a4858f25ef51518ab8aa498a8dd0d8561347fb2c8aec8cf3f71f3505a6230 WatchSource:0}: Error finding container 341a4858f25ef51518ab8aa498a8dd0d8561347fb2c8aec8cf3f71f3505a6230: Status 404 returned error can't find the container with id 341a4858f25ef51518ab8aa498a8dd0d8561347fb2c8aec8cf3f71f3505a6230 Jun 10 20:46:13.949891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:13.949856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n"] Jun 10 20:46:13.952722 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:13.952694 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0f22e0_f1f8_4af8_ac36_ac95560d3cc5.slice/crio-e5f77f9f2ebd7f0cae7c8e6cd97c721089a64e597332c6ca14dde651182549ce WatchSource:0}: Error finding container e5f77f9f2ebd7f0cae7c8e6cd97c721089a64e597332c6ca14dde651182549ce: Status 404 returned error can't find the container with id e5f77f9f2ebd7f0cae7c8e6cd97c721089a64e597332c6ca14dde651182549ce Jun 10 20:46:14.791741 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:14.791699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" event={"ID":"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5","Type":"ContainerStarted","Data":"e5f77f9f2ebd7f0cae7c8e6cd97c721089a64e597332c6ca14dde651182549ce"} Jun 10 20:46:14.793104 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:14.793071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9554c8bc-494w7" event={"ID":"89bbb819-6add-4757-a8ea-0a1d0a59d30f","Type":"ContainerStarted","Data":"341a4858f25ef51518ab8aa498a8dd0d8561347fb2c8aec8cf3f71f3505a6230"} Jun 10 20:46:16.806942 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:16.806904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9554c8bc-494w7" event={"ID":"89bbb819-6add-4757-a8ea-0a1d0a59d30f","Type":"ContainerStarted","Data":"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b"} Jun 10 20:46:16.808520 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:16.808500 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" event={"ID":"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5","Type":"ContainerStarted","Data":"e71512dc883478e0b2285fa1adec52f8d67026c56221789e137fcc26be2c5bb7"} Jun 10 20:46:16.808590 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:16.808546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" event={"ID":"9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5","Type":"ContainerStarted","Data":"d0ce8125c8f4df445708a35544ef357391b5805c24ed2a041a13d622ca5d1837"} Jun 10 20:46:16.825019 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:16.824978 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c9554c8bc-494w7" podStartSLOduration=1.2423919780000001 podStartE2EDuration="3.824965348s" totalImagesPullingTime="2.58257337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:16.824562394 +0000 UTC m=+251.293761246" watchObservedRunningTime="2026-06-10 20:46:16.824965348 +0000 UTC m=+251.294164207" Jun 10 20:46:16.842450 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:16.842400 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xsn6n" podStartSLOduration=2.398797728 podStartE2EDuration="4.842389s" totalImagesPullingTime="2.443591272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:16.841068823 +0000 UTC m=+251.310267683" watchObservedRunningTime="2026-06-10 20:46:16.842389 +0000 UTC m=+251.311587858" Jun 10 20:46:17.783178 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:17.783144 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:46:17.785541 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:17.785523 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfe6db47-fd6e-499d-afc1-0f1f215bcb64-metrics-certs\") pod \"network-metrics-daemon-27dpd\" (UID: \"bfe6db47-fd6e-499d-afc1-0f1f215bcb64\") " pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:46:17.917114 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:17.917086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:46:17.925038 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:17.924928 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27dpd" Jun 10 20:46:18.071828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.071759 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27dpd"] Jun 10 20:46:18.074658 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:18.074613 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe6db47_fd6e_499d_afc1_0f1f215bcb64.slice/crio-774dc0a2f422df814c1f9a63e21c5842760d11b05fac82d8f6ac5533734aa6bb WatchSource:0}: Error finding container 774dc0a2f422df814c1f9a63e21c5842760d11b05fac82d8f6ac5533734aa6bb: Status 404 returned error can't find the container with id 774dc0a2f422df814c1f9a63e21c5842760d11b05fac82d8f6ac5533734aa6bb Jun 10 20:46:18.247174 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.247141 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vx9p9"] Jun 10 20:46:18.250101 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.250083 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.252638 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.252610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 20:46:18.252773 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.252637 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hxgnn\"" Jun 10 20:46:18.253099 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.253081 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 20:46:18.253371 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.253355 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 20:46:18.287062 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287029 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-metrics-client-ca\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287227 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-root\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287227 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-sys\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287227 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287227 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287355 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd9ng\" (UniqueName: \"kubernetes.io/projected/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-kube-api-access-kd9ng\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287355 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-textfile\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287355 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.287355 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.287305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-wtmp\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388711 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-metrics-client-ca\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388711 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-root\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388711 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-sys\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388758 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-root\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd9ng\" (UniqueName: \"kubernetes.io/projected/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-kube-api-access-kd9ng\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388764 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-sys\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-textfile\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.388961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388916 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.389264 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.388966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-wtmp\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.389264 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:18.389062 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 20:46:18.389264 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.389134 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-wtmp\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.389264 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:18.389138 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls podName:22e49fe6-b34c-41dd-80dd-dc5b7eece2fd nodeName:}" failed. No retries permitted until 2026-06-10 20:46:18.889118444 +0000 UTC m=+253.358317283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls") pod "node-exporter-vx9p9" (UID: "22e49fe6-b34c-41dd-80dd-dc5b7eece2fd") : secret "node-exporter-tls" not found Jun 10 20:46:18.389416 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.389346 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-metrics-client-ca\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.389499 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.389483 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-textfile\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.389655 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.389638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.391193 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.391174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.399148 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.399127 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd9ng\" (UniqueName: \"kubernetes.io/projected/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-kube-api-access-kd9ng\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.816224 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.816182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27dpd" event={"ID":"bfe6db47-fd6e-499d-afc1-0f1f215bcb64","Type":"ContainerStarted","Data":"774dc0a2f422df814c1f9a63e21c5842760d11b05fac82d8f6ac5533734aa6bb"} Jun 10 20:46:18.891873 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.891833 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:18.894849 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:18.894817 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22e49fe6-b34c-41dd-80dd-dc5b7eece2fd-node-exporter-tls\") pod \"node-exporter-vx9p9\" (UID: \"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd\") " pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:19.160090 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:19.160054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vx9p9" Jun 10 20:46:19.171921 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:19.171886 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e49fe6_b34c_41dd_80dd_dc5b7eece2fd.slice/crio-67f1ca9a02381708bd44c27a04df11473f6a4e3938f6ff075a7e9349b2f4a9c3 WatchSource:0}: Error finding container 67f1ca9a02381708bd44c27a04df11473f6a4e3938f6ff075a7e9349b2f4a9c3: Status 404 returned error can't find the container with id 67f1ca9a02381708bd44c27a04df11473f6a4e3938f6ff075a7e9349b2f4a9c3 Jun 10 20:46:19.821165 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:19.821129 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx9p9" event={"ID":"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd","Type":"ContainerStarted","Data":"67f1ca9a02381708bd44c27a04df11473f6a4e3938f6ff075a7e9349b2f4a9c3"} Jun 10 20:46:19.823141 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:19.823104 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27dpd" event={"ID":"bfe6db47-fd6e-499d-afc1-0f1f215bcb64","Type":"ContainerStarted","Data":"dcf6fa4f3a660a8379472398fc3a2031c4e33190ef535ea395ee8e8b482220cb"} Jun 10 20:46:19.823264 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:19.823156 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27dpd" event={"ID":"bfe6db47-fd6e-499d-afc1-0f1f215bcb64","Type":"ContainerStarted","Data":"81d4721032a3c15b3e6c7c4da9c3ff789a33df850bb984c54e808f4e70539c90"} Jun 10 20:46:19.842751 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:19.842625 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-27dpd" podStartSLOduration=252.973383016 podStartE2EDuration="4m13.842603541s" totalImagesPullingTime="869.220525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:19.840069162 +0000 UTC m=+254.309268023" watchObservedRunningTime="2026-06-10 20:46:19.842603541 +0000 UTC m=+254.311802400" Jun 10 20:46:20.828734 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:20.828662 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e49fe6-b34c-41dd-80dd-dc5b7eece2fd" containerID="14e86f4dfc4b541192d0bdd7313a6b255193778f554d06bdc81b6aae550bd7a3" exitCode=0 Jun 10 20:46:20.829116 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:20.828758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx9p9" event={"ID":"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd","Type":"ContainerDied","Data":"14e86f4dfc4b541192d0bdd7313a6b255193778f554d06bdc81b6aae550bd7a3"} Jun 10 20:46:21.833863 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:21.833825 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx9p9" event={"ID":"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd","Type":"ContainerStarted","Data":"ca7eb8ff26eccba2b7493015c181a0e5ebbb1c72e7b6ff0fe8edb844f78f20db"} Jun 10 20:46:21.834289 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:21.833876 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vx9p9" event={"ID":"22e49fe6-b34c-41dd-80dd-dc5b7eece2fd","Type":"ContainerStarted","Data":"b8b26c3ccb695dda4ea5a429fd62c19bdf166161be2e47b937f8b88116aa7f44"} Jun 10 20:46:21.856226 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:21.856173 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vx9p9" podStartSLOduration=2.871163572 podStartE2EDuration="3.856155476s" totalImagesPullingTime="910.772011ms" totalInitContainerRuntime="74.219893ms" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:21.854315771 +0000 UTC m=+256.323514630" watchObservedRunningTime="2026-06-10 20:46:21.856155476 +0000 UTC m=+256.325354335" Jun 10 20:46:22.625374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.625339 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57c496979-7zthv"] Jun 10 20:46:22.628291 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.628275 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.631240 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.631215 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 20:46:22.632548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.632529 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qsfxq\"" Jun 10 20:46:22.632642 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.632550 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 20:46:22.632768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.632753 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 20:46:22.632852 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.632801 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f2d84die0r4mk\"" Jun 10 20:46:22.632852 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.632811 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 20:46:22.638009 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.637987 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57c496979-7zthv"] Jun 10 20:46:22.721460 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-metrics-server-audit-profiles\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721460 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shb7w\" (UniqueName: \"kubernetes.io/projected/fa348a99-99b4-474b-9e4b-6c71e15e96ff-kube-api-access-shb7w\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa348a99-99b4-474b-9e4b-6c71e15e96ff-audit-log\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-tls\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-client-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.721713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.721640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-client-certs\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.822928 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.822895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-metrics-server-audit-profiles\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.822928 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.822933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shb7w\" (UniqueName: \"kubernetes.io/projected/fa348a99-99b4-474b-9e4b-6c71e15e96ff-kube-api-access-shb7w\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.822958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.822984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa348a99-99b4-474b-9e4b-6c71e15e96ff-audit-log\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-tls\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-client-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823172 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823092 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-client-certs\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823530 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823492 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fa348a99-99b4-474b-9e4b-6c71e15e96ff-audit-log\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.823808 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823783 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.824085 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.823993 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fa348a99-99b4-474b-9e4b-6c71e15e96ff-metrics-server-audit-profiles\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.825703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.825645 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-client-certs\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.825780 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.825750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-secret-metrics-server-tls\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.825828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.825804 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa348a99-99b4-474b-9e4b-6c71e15e96ff-client-ca-bundle\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.832588 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.832563 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shb7w\" (UniqueName: \"kubernetes.io/projected/fa348a99-99b4-474b-9e4b-6c71e15e96ff-kube-api-access-shb7w\") pod \"metrics-server-57c496979-7zthv\" (UID: \"fa348a99-99b4-474b-9e4b-6c71e15e96ff\") " pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:22.937607 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:22.937526 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:23.041263 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.041228 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj"] Jun 10 20:46:23.046990 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.046180 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.049409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.049382 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 20:46:23.049409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.049395 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vjlnh\"" Jun 10 20:46:23.055575 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.055133 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj"] Jun 10 20:46:23.064146 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.064121 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:46:23.067628 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.067608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.076311 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.076287 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:46:23.087205 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.087176 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57c496979-7zthv"] Jun 10 20:46:23.090414 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:23.090389 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa348a99_99b4_474b_9e4b_6c71e15e96ff.slice/crio-b4d7f98dc6f71a2722ea92fcfce7e9c0c0593558a32280948fd19f35a66c1e65 WatchSource:0}: Error finding container b4d7f98dc6f71a2722ea92fcfce7e9c0c0593558a32280948fd19f35a66c1e65: Status 404 returned error can't find the container with id b4d7f98dc6f71a2722ea92fcfce7e9c0c0593558a32280948fd19f35a66c1e65 Jun 10 20:46:23.126078 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126038 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126078 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126293 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126098 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126293 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126293 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126293 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpzcw\" (UniqueName: \"kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.126431 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.126431 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxlc2\" (UniqueName: \"kubernetes.io/projected/b03b4908-1751-496d-9d51-36289a439d12-kube-api-access-gxlc2\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.126431 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.126380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.226762 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzcw\" (UniqueName: \"kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226811 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxlc2\" (UniqueName: \"kubernetes.io/projected/b03b4908-1751-496d-9d51-36289a439d12-kube-api-access-gxlc2\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:23.226887 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.226937 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.227273 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:23.226946 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert podName:b03b4908-1751-496d-9d51-36289a439d12 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:23.726923505 +0000 UTC m=+258.196122345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-mqnvj" (UID: "b03b4908-1751-496d-9d51-36289a439d12") : secret "monitoring-plugin-cert" not found Jun 10 20:46:23.227273 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.226978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.227273 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.227067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.227648 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.227596 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.227891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.227869 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.227938 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.227895 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.228148 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.228132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.229556 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.229539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.229609 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.229568 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.238058 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.238027 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxlc2\" (UniqueName: \"kubernetes.io/projected/b03b4908-1751-496d-9d51-36289a439d12-kube-api-access-gxlc2\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.238205 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.238191 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzcw\" (UniqueName: \"kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw\") pod \"console-747dd657ff-qt84v\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.377536 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.377461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:23.421557 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.421522 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fb59f485f-pnzmw"] Jun 10 20:46:23.425189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.425168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.428522 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.428237 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gsbrr\"" Jun 10 20:46:23.428522 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.428237 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 20:46:23.428522 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.428332 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 20:46:23.429586 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.429348 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 20:46:23.429586 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.429387 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 20:46:23.429586 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.429475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 20:46:23.434010 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.433983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 20:46:23.438828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.438799 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb59f485f-pnzmw"] Jun 10 20:46:23.515106 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.515078 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:46:23.517737 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:23.517710 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f81f1bb_06bb_40e7_8513_b0522357eab4.slice/crio-ecfb6e398baa9fc39364f5ac042677da8815ab3a7ad11c8af8d2b9b548947a85 WatchSource:0}: Error finding container ecfb6e398baa9fc39364f5ac042677da8815ab3a7ad11c8af8d2b9b548947a85: Status 404 returned error can't find the container with id ecfb6e398baa9fc39364f5ac042677da8815ab3a7ad11c8af8d2b9b548947a85 Jun 10 20:46:23.529103 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529188 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529140 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-metrics-client-ca\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529228 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529189 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4gc\" (UniqueName: \"kubernetes.io/projected/a3b8e672-3f6b-4b45-a341-b412b2c9404d-kube-api-access-vm4gc\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529276 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529276 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529248 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529372 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529420 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-federate-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.529473 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.529421 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-serving-certs-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-metrics-client-ca\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4gc\" (UniqueName: \"kubernetes.io/projected/a3b8e672-3f6b-4b45-a341-b412b2c9404d-kube-api-access-vm4gc\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630538 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-federate-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.630782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-serving-certs-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.631243 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.630948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.631909 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.631382 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-metrics-client-ca\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.631909 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.631578 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.631909 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.631869 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3b8e672-3f6b-4b45-a341-b412b2c9404d-serving-certs-ca-bundle\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.633808 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.633777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-federate-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.634116 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.634093 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.634367 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.634348 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-telemeter-client-tls\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.635228 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.635205 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3b8e672-3f6b-4b45-a341-b412b2c9404d-secret-telemeter-client\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.639906 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.639885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4gc\" (UniqueName: \"kubernetes.io/projected/a3b8e672-3f6b-4b45-a341-b412b2c9404d-kube-api-access-vm4gc\") pod \"telemeter-client-5fb59f485f-pnzmw\" (UID: \"a3b8e672-3f6b-4b45-a341-b412b2c9404d\") " pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.726126 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.726084 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:23.726290 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.726153 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:23.727537 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.727510 2582 patch_prober.go:28] interesting pod/console-5c9554c8bc-494w7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 10 20:46:23.727628 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.727561 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c9554c8bc-494w7" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 10 20:46:23.731951 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.731925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.734560 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.734536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b03b4908-1751-496d-9d51-36289a439d12-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-mqnvj\" (UID: \"b03b4908-1751-496d-9d51-36289a439d12\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:23.738693 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.738657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" Jun 10 20:46:23.790350 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.790253 2582 patch_prober.go:28] interesting pod/image-registry-6dcb7c865c-l8bzd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:23.790602 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.790564 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:23.846119 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.846079 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dd657ff-qt84v" event={"ID":"8f81f1bb-06bb-40e7-8513-b0522357eab4","Type":"ContainerStarted","Data":"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce"} Jun 10 20:46:23.846244 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.846151 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dd657ff-qt84v" event={"ID":"8f81f1bb-06bb-40e7-8513-b0522357eab4","Type":"ContainerStarted","Data":"ecfb6e398baa9fc39364f5ac042677da8815ab3a7ad11c8af8d2b9b548947a85"} Jun 10 20:46:23.848115 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.848046 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57c496979-7zthv" event={"ID":"fa348a99-99b4-474b-9e4b-6c71e15e96ff","Type":"ContainerStarted","Data":"b4d7f98dc6f71a2722ea92fcfce7e9c0c0593558a32280948fd19f35a66c1e65"} Jun 10 20:46:23.868523 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.868466 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-747dd657ff-qt84v" podStartSLOduration=0.868446254 podStartE2EDuration="868.446254ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:23.866856419 +0000 UTC m=+258.336055280" watchObservedRunningTime="2026-06-10 20:46:23.868446254 +0000 UTC m=+258.337645161" Jun 10 20:46:23.897041 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.897007 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb59f485f-pnzmw"] Jun 10 20:46:23.900754 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:23.900721 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b8e672_3f6b_4b45_a341_b412b2c9404d.slice/crio-ec66e39557c620b4db350d76a805060ec8759f012d6abafaf7d56aeea539452b WatchSource:0}: Error finding container ec66e39557c620b4db350d76a805060ec8759f012d6abafaf7d56aeea539452b: Status 404 returned error can't find the container with id ec66e39557c620b4db350d76a805060ec8759f012d6abafaf7d56aeea539452b Jun 10 20:46:23.964150 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:23.964113 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:24.109971 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:24.109940 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj"] Jun 10 20:46:24.112945 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:24.112912 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03b4908_1751_496d_9d51_36289a439d12.slice/crio-0738adde12ae41f61fba298f57c5383698cffdc101ed030fe74c0b536c8bfaf2 WatchSource:0}: Error finding container 0738adde12ae41f61fba298f57c5383698cffdc101ed030fe74c0b536c8bfaf2: Status 404 returned error can't find the container with id 0738adde12ae41f61fba298f57c5383698cffdc101ed030fe74c0b536c8bfaf2 Jun 10 20:46:24.854073 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:24.854031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" event={"ID":"b03b4908-1751-496d-9d51-36289a439d12","Type":"ContainerStarted","Data":"0738adde12ae41f61fba298f57c5383698cffdc101ed030fe74c0b536c8bfaf2"} Jun 10 20:46:24.855686 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:24.855654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57c496979-7zthv" event={"ID":"fa348a99-99b4-474b-9e4b-6c71e15e96ff","Type":"ContainerStarted","Data":"2b78061de20f5577bb76c3d47c91b47328894cd8c4059997021ee1a0d418e583"} Jun 10 20:46:24.857006 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:24.856983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" event={"ID":"a3b8e672-3f6b-4b45-a341-b412b2c9404d","Type":"ContainerStarted","Data":"ec66e39557c620b4db350d76a805060ec8759f012d6abafaf7d56aeea539452b"} Jun 10 20:46:24.875673 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:24.875617 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57c496979-7zthv" podStartSLOduration=1.205483152 podStartE2EDuration="2.875593533s" totalImagesPullingTime="1.670110381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:24.874381873 +0000 UTC m=+259.343580733" watchObservedRunningTime="2026-06-10 20:46:24.875593533 +0000 UTC m=+259.344792392" Jun 10 20:46:26.870539 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:26.870492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" event={"ID":"a3b8e672-3f6b-4b45-a341-b412b2c9404d","Type":"ContainerStarted","Data":"277fba561256fd8e765c7d44b6fd4282cbc36cc33e4bc28a157187f587a85cd8"} Jun 10 20:46:26.871786 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:26.871762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" event={"ID":"b03b4908-1751-496d-9d51-36289a439d12","Type":"ContainerStarted","Data":"08d730e63b4922d2f407fb99270172165d30e64ad4d8891b79b56af7073e3f32"} Jun 10 20:46:26.872003 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:26.871983 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:26.876884 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:26.876860 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" Jun 10 20:46:26.889273 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:26.889225 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-mqnvj" podStartSLOduration=2.051052604 podStartE2EDuration="3.889211627s" totalImagesPullingTime="1.838159023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:26.887261279 +0000 UTC m=+261.356460151" watchObservedRunningTime="2026-06-10 20:46:26.889211627 +0000 UTC m=+261.358410533" Jun 10 20:46:27.878292 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:27.878200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" event={"ID":"a3b8e672-3f6b-4b45-a341-b412b2c9404d","Type":"ContainerStarted","Data":"4bd79fc26d7e2a800749a1c903fe22c74f76e3d35ba9d5705bacdc723e7715ad"} Jun 10 20:46:27.878292 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:27.878260 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" event={"ID":"a3b8e672-3f6b-4b45-a341-b412b2c9404d","Type":"ContainerStarted","Data":"09906f68507388eba10d4356107ca997e78190ffdc62b84ba8640a886da06ba2"} Jun 10 20:46:27.901373 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:27.901323 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fb59f485f-pnzmw" podStartSLOduration=1.3925047830000001 podStartE2EDuration="4.901305785s" totalImagesPullingTime="3.508801002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:27.899883928 +0000 UTC m=+262.369082783" watchObservedRunningTime="2026-06-10 20:46:27.901305785 +0000 UTC m=+262.370504646" Jun 10 20:46:27.999011 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:27.998975 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:28.805425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:28.805378 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" containerID="cri-o://bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8" gracePeriod=30 Jun 10 20:46:29.041100 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.041073 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:46:29.080725 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080617 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.080725 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080657 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.080725 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080693 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.080725 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080714 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.081026 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080747 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.081026 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080781 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.081026 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080874 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.081026 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.080908 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h7xc\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc\") pod \"ad4b17e5-1006-45f6-8a22-935448964f0f\" (UID: \"ad4b17e5-1006-45f6-8a22-935448964f0f\") " Jun 10 20:46:29.081256 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.081202 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:29.081307 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.081280 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:29.083380 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.083331 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:29.083552 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.083527 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:46:29.083715 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.083672 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:46:29.083785 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.083710 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc" (OuterVolumeSpecName: "kube-api-access-2h7xc") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "kube-api-access-2h7xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:46:29.083785 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.083744 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:29.089235 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.089210 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ad4b17e5-1006-45f6-8a22-935448964f0f" (UID: "ad4b17e5-1006-45f6-8a22-935448964f0f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:46:29.182315 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182273 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad4b17e5-1006-45f6-8a22-935448964f0f-ca-trust-extracted\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182315 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182308 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h7xc\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-kube-api-access-2h7xc\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182315 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182321 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-trusted-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182334 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-bound-sa-token\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182346 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-image-registry-private-configuration\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182358 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-tls\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182369 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad4b17e5-1006-45f6-8a22-935448964f0f-installation-pull-secrets\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.182543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.182380 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad4b17e5-1006-45f6-8a22-935448964f0f-registry-certificates\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:29.886751 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.886713 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerID="bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8" exitCode=0 Jun 10 20:46:29.886946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.886765 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" event={"ID":"ad4b17e5-1006-45f6-8a22-935448964f0f","Type":"ContainerDied","Data":"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8"} Jun 10 20:46:29.886946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.886795 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" Jun 10 20:46:29.886946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.886813 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcb7c865c-l8bzd" event={"ID":"ad4b17e5-1006-45f6-8a22-935448964f0f","Type":"ContainerDied","Data":"21ce0503c2226f8cb5d4f592d14d7b717dad2c6ecdaf7aa6b74354e0926b9f1d"} Jun 10 20:46:29.886946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.886853 2582 scope.go:117] "RemoveContainer" containerID="bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8" Jun 10 20:46:29.895529 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.895511 2582 scope.go:117] "RemoveContainer" containerID="bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8" Jun 10 20:46:29.895792 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:29.895766 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8\": container with ID starting with bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8 not found: ID does not exist" containerID="bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8" Jun 10 20:46:29.895845 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.895803 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8"} err="failed to get container status \"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8\": rpc error: code = NotFound desc = could not find container \"bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8\": container with ID starting with bf61ee2629e79cc907e3cab2f1ce98f770dd8a6dacff39d7aa95571111730bc8 not found: ID does not exist" Jun 10 20:46:29.907572 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.907549 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:46:29.913978 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:29.913955 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dcb7c865c-l8bzd"] Jun 10 20:46:30.018309 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:30.018276 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" path="/var/lib/kubelet/pods/ad4b17e5-1006-45f6-8a22-935448964f0f/volumes" Jun 10 20:46:33.377857 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:33.377823 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:33.378278 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:33.377879 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:46:33.379425 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:33.379398 2582 patch_prober.go:28] interesting pod/console-747dd657ff-qt84v container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 10 20:46:33.379536 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:33.379447 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-747dd657ff-qt84v" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 10 20:46:42.938654 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:42.938618 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:42.939144 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:42.938697 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:46:43.378141 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:43.378101 2582 patch_prober.go:28] interesting pod/console-747dd657ff-qt84v container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 10 20:46:43.378323 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:43.378155 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-747dd657ff-qt84v" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 10 20:46:47.500401 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:47.500356 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sjnql" podUID="025d69db-7f09-45ce-919a-39dc16f9150e" Jun 10 20:46:47.953520 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:47.953487 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjnql" Jun 10 20:46:50.861400 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:50.861343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:46:50.863801 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:50.863780 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/025d69db-7f09-45ce-919a-39dc16f9150e-metrics-tls\") pod \"dns-default-sjnql\" (UID: \"025d69db-7f09-45ce-919a-39dc16f9150e\") " pod="openshift-dns/dns-default-sjnql" Jun 10 20:46:50.957375 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:50.957342 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:46:50.964768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:50.964743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjnql" Jun 10 20:46:51.100169 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:51.100147 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjnql"] Jun 10 20:46:51.102198 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:46:51.102164 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025d69db_7f09_45ce_919a_39dc16f9150e.slice/crio-5b9ae6127384749a3002b848c56a3495d332ea9da40696f74fe19aeb8146b491 WatchSource:0}: Error finding container 5b9ae6127384749a3002b848c56a3495d332ea9da40696f74fe19aeb8146b491: Status 404 returned error can't find the container with id 5b9ae6127384749a3002b848c56a3495d332ea9da40696f74fe19aeb8146b491 Jun 10 20:46:51.970658 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:51.970618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjnql" event={"ID":"025d69db-7f09-45ce-919a-39dc16f9150e","Type":"ContainerStarted","Data":"5b9ae6127384749a3002b848c56a3495d332ea9da40696f74fe19aeb8146b491"} Jun 10 20:46:52.976239 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:52.976213 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjnql" event={"ID":"025d69db-7f09-45ce-919a-39dc16f9150e","Type":"ContainerStarted","Data":"c377e8be01ac4e6bad9f663414c96e17b6490d07eb95bc509b3503a563ec4daa"} Jun 10 20:46:53.019334 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.019294 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c9554c8bc-494w7" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerName="console" containerID="cri-o://3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b" gracePeriod=15 Jun 10 20:46:53.253656 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.253631 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:53.378021 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.377983 2582 patch_prober.go:28] interesting pod/console-747dd657ff-qt84v container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 10 20:46:53.378192 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.378031 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-747dd657ff-qt84v" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 10 20:46:53.382269 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382219 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382328 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382281 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382328 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382307 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5xd8\" (UniqueName: \"kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382340 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382356 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382379 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382572 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382423 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert\") pod \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\" (UID: \"89bbb819-6add-4757-a8ea-0a1d0a59d30f\") " Jun 10 20:46:53.382738 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382712 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config" (OuterVolumeSpecName: "console-config") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:53.382870 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382840 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca" (OuterVolumeSpecName: "service-ca") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:53.382930 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382869 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:53.382930 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.382868 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:53.384914 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.384891 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8" (OuterVolumeSpecName: "kube-api-access-l5xd8") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "kube-api-access-l5xd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:46:53.385016 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.384932 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:53.385016 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.385000 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89bbb819-6add-4757-a8ea-0a1d0a59d30f" (UID: "89bbb819-6add-4757-a8ea-0a1d0a59d30f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:53.483657 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483607 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483657 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483652 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483657 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483664 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5xd8\" (UniqueName: \"kubernetes.io/projected/89bbb819-6add-4757-a8ea-0a1d0a59d30f-kube-api-access-l5xd8\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483673 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483706 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483715 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bbb819-6add-4757-a8ea-0a1d0a59d30f-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.483908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.483723 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89bbb819-6add-4757-a8ea-0a1d0a59d30f-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:46:53.980745 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.980711 2582 generic.go:356] "Generic (PLEG): container finished" podID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerID="3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b" exitCode=0 Jun 10 20:46:53.981186 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.980810 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9554c8bc-494w7" Jun 10 20:46:53.981186 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.980822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9554c8bc-494w7" event={"ID":"89bbb819-6add-4757-a8ea-0a1d0a59d30f","Type":"ContainerDied","Data":"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b"} Jun 10 20:46:53.981186 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.980875 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9554c8bc-494w7" event={"ID":"89bbb819-6add-4757-a8ea-0a1d0a59d30f","Type":"ContainerDied","Data":"341a4858f25ef51518ab8aa498a8dd0d8561347fb2c8aec8cf3f71f3505a6230"} Jun 10 20:46:53.981186 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.980903 2582 scope.go:117] "RemoveContainer" containerID="3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b" Jun 10 20:46:53.982813 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.982790 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjnql" event={"ID":"025d69db-7f09-45ce-919a-39dc16f9150e","Type":"ContainerStarted","Data":"bb4ee77bb1f31b491aedee262d45e6c5a48497744aeafd55d0ba8fe6e8b7a8d5"} Jun 10 20:46:53.982904 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.982883 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sjnql" Jun 10 20:46:53.992140 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.992121 2582 scope.go:117] "RemoveContainer" containerID="3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b" Jun 10 20:46:53.992380 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:53.992364 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b\": container with ID starting with 3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b not found: ID does not exist" containerID="3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b" Jun 10 20:46:53.992417 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:53.992389 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b"} err="failed to get container status \"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b\": rpc error: code = NotFound desc = could not find container \"3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b\": container with ID starting with 3a706e80dc5f5304ae123d8447daa957241bcdd9612c911e5ab19b21efc1f68b not found: ID does not exist" Jun 10 20:46:54.004152 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:54.004086 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sjnql" podStartSLOduration=252.291877105 podStartE2EDuration="4m14.004073026s" totalImagesPullingTime="1.712195921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:54.002897493 +0000 UTC m=+288.472096362" watchObservedRunningTime="2026-06-10 20:46:54.004073026 +0000 UTC m=+288.473271903" Jun 10 20:46:54.018704 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:54.018647 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:54.020124 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:54.020093 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9554c8bc-494w7"] Jun 10 20:46:56.018371 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:56.018319 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" path="/var/lib/kubelet/pods/89bbb819-6add-4757-a8ea-0a1d0a59d30f/volumes" Jun 10 20:46:56.996284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:56.996249 2582 generic.go:356] "Generic (PLEG): container finished" podID="539e0b33-e2ea-4622-a17e-204db8931b4d" containerID="a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799" exitCode=1 Jun 10 20:46:56.996452 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:56.996326 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerDied","Data":"a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799"} Jun 10 20:46:56.996452 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:56.996394 2582 scope.go:117] "RemoveContainer" containerID="4956419b9560053fe27238965f2855a1e6aea4eb011fb6ea608fbab245bdd5a7" Jun 10 20:46:56.996772 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:56.996752 2582 scope.go:117] "RemoveContainer" containerID="a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799" Jun 10 20:46:56.996967 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:56.996947 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-785b979b6c-4l95j_open-cluster-management-agent-addon(539e0b33-e2ea-4622-a17e-204db8931b4d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" podUID="539e0b33-e2ea-4622-a17e-204db8931b4d" Jun 10 20:46:57.500374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:57.500334 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:46:57.534668 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:57.534636 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:46:58.001340 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:58.001307 2582 scope.go:117] "RemoveContainer" containerID="a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799" Jun 10 20:46:58.001517 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:58.001497 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-785b979b6c-4l95j_open-cluster-management-agent-addon(539e0b33-e2ea-4622-a17e-204db8931b4d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" podUID="539e0b33-e2ea-4622-a17e-204db8931b4d" Jun 10 20:46:58.415185 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:58.415099 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:46:59.005621 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:46:59.005595 2582 scope.go:117] "RemoveContainer" containerID="a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799" Jun 10 20:46:59.006067 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:46:59.005795 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-785b979b6c-4l95j_open-cluster-management-agent-addon(539e0b33-e2ea-4622-a17e-204db8931b4d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" podUID="539e0b33-e2ea-4622-a17e-204db8931b4d" Jun 10 20:47:02.943907 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:02.943874 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:47:02.947794 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:02.947765 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57c496979-7zthv" Jun 10 20:47:03.989619 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:03.989591 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sjnql" Jun 10 20:47:05.973284 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:05.973260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:47:05.974756 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:05.974737 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:47:05.979626 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:05.979605 2582 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 20:47:11.013129 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:11.013094 2582 scope.go:117] "RemoveContainer" containerID="a48112fb83b543769805a784bf1b77dc7e12768e627f0d1dafcbdb09a1361799" Jun 10 20:47:12.054209 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:12.054174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" event={"ID":"539e0b33-e2ea-4622-a17e-204db8931b4d","Type":"ContainerStarted","Data":"07524d554be3eca0f5077c6f2421cd4bd2e70c2226cb67c7baefb5ad9889abe2"} Jun 10 20:47:12.054708 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:12.054512 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:47:12.056157 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:12.056137 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785b979b6c-4l95j" Jun 10 20:47:23.436229 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.436165 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-747dd657ff-qt84v" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" containerID="cri-o://4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce" gracePeriod=15 Jun 10 20:47:23.683122 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.683096 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:47:23.718085 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718048 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718238 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718119 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718238 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718178 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpzcw\" (UniqueName: \"kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718238 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718224 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718383 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718246 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718383 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718271 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718482 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718396 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config" (OuterVolumeSpecName: "console-config") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:23.718482 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718406 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert\") pod \"8f81f1bb-06bb-40e7-8513-b0522357eab4\" (UID: \"8f81f1bb-06bb-40e7-8513-b0522357eab4\") " Jun 10 20:47:23.718625 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718600 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:23.718705 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718645 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:23.718705 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718673 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.718795 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718714 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-oauth-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.718795 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.718670 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:23.720639 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.720616 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:23.720923 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.720896 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:23.720923 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.720908 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw" (OuterVolumeSpecName: "kube-api-access-tpzcw") pod "8f81f1bb-06bb-40e7-8513-b0522357eab4" (UID: "8f81f1bb-06bb-40e7-8513-b0522357eab4"). InnerVolumeSpecName "kube-api-access-tpzcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:23.819211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.819159 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-oauth-config\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.819211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.819202 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpzcw\" (UniqueName: \"kubernetes.io/projected/8f81f1bb-06bb-40e7-8513-b0522357eab4-kube-api-access-tpzcw\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.819211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.819212 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-service-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.819211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.819221 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f81f1bb-06bb-40e7-8513-b0522357eab4-trusted-ca-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:23.819211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:23.819230 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f81f1bb-06bb-40e7-8513-b0522357eab4-console-serving-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:47:24.095641 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.095602 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerID="4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce" exitCode=0 Jun 10 20:47:24.095825 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.095645 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dd657ff-qt84v" Jun 10 20:47:24.095825 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.095711 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dd657ff-qt84v" event={"ID":"8f81f1bb-06bb-40e7-8513-b0522357eab4","Type":"ContainerDied","Data":"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce"} Jun 10 20:47:24.095825 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.095762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dd657ff-qt84v" event={"ID":"8f81f1bb-06bb-40e7-8513-b0522357eab4","Type":"ContainerDied","Data":"ecfb6e398baa9fc39364f5ac042677da8815ab3a7ad11c8af8d2b9b548947a85"} Jun 10 20:47:24.095825 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.095783 2582 scope.go:117] "RemoveContainer" containerID="4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce" Jun 10 20:47:24.104248 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.104231 2582 scope.go:117] "RemoveContainer" containerID="4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce" Jun 10 20:47:24.104478 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:47:24.104456 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce\": container with ID starting with 4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce not found: ID does not exist" containerID="4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce" Jun 10 20:47:24.104544 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.104486 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce"} err="failed to get container status \"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce\": rpc error: code = NotFound desc = could not find container \"4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce\": container with ID starting with 4b4a429359d42392b8ac24269188467502a7031cf67ec710976e82c59fb2c3ce not found: ID does not exist" Jun 10 20:47:24.113297 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.113275 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:47:24.116978 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:24.116957 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-747dd657ff-qt84v"] Jun 10 20:47:26.017889 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:47:26.017857 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" path="/var/lib/kubelet/pods/8f81f1bb-06bb-40e7-8513-b0522357eab4/volumes" Jun 10 20:48:40.986237 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986199 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb"] Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986508 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986520 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986536 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986541 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986551 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986556 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986612 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f81f1bb-06bb-40e7-8513-b0522357eab4" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986619 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bbb819-6add-4757-a8ea-0a1d0a59d30f" containerName="console" Jun 10 20:48:40.986703 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.986626 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad4b17e5-1006-45f6-8a22-935448964f0f" containerName="registry" Jun 10 20:48:40.989713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.989673 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:40.992295 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.992273 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:48:40.993479 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.993454 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:48:40.993584 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.993464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:48:40.997775 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:40.997750 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb"] Jun 10 20:48:41.101954 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.101926 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.102156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.101963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btrfk\" (UniqueName: \"kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.102156 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.101984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.202922 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.202883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.203097 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.202931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btrfk\" (UniqueName: \"kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.203097 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.202960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.203333 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.203314 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.203372 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.203328 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.211160 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.211129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btrfk\" (UniqueName: \"kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.299283 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.299208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:48:41.428093 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.428060 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb"] Jun 10 20:48:41.430867 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:48:41.430836 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bac327_bee5_4f5d_9c01_449904ea027f.slice/crio-45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8 WatchSource:0}: Error finding container 45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8: Status 404 returned error can't find the container with id 45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8 Jun 10 20:48:41.432891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:41.432874 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:48:42.378946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:42.378908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerStarted","Data":"45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8"} Jun 10 20:48:47.401412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:47.401377 2582 generic.go:356] "Generic (PLEG): container finished" podID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerID="3fdb4ad4aa3707e9e748c0b02900be1d082ebdd44577603e6790cbe8eb0c2062" exitCode=0 Jun 10 20:48:47.401809 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:47.401469 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerDied","Data":"3fdb4ad4aa3707e9e748c0b02900be1d082ebdd44577603e6790cbe8eb0c2062"} Jun 10 20:48:49.412104 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:49.412069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerStarted","Data":"4df67fab0ac504f19a6bfb4a9aec1a48c2ae23cfe893f8232da705edd52771d2"} Jun 10 20:48:50.417557 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:50.417521 2582 generic.go:356] "Generic (PLEG): container finished" podID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerID="4df67fab0ac504f19a6bfb4a9aec1a48c2ae23cfe893f8232da705edd52771d2" exitCode=0 Jun 10 20:48:50.417951 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:50.417607 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerDied","Data":"4df67fab0ac504f19a6bfb4a9aec1a48c2ae23cfe893f8232da705edd52771d2"} Jun 10 20:48:59.455412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:59.455370 2582 generic.go:356] "Generic (PLEG): container finished" podID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerID="37b9db0231d434b93de9174988d31b936ee9927b6b52686529e21387e97cd85e" exitCode=0 Jun 10 20:48:59.455830 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:48:59.455465 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerDied","Data":"37b9db0231d434b93de9174988d31b936ee9927b6b52686529e21387e97cd85e"} Jun 10 20:49:00.582123 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.582099 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:49:00.633652 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.633620 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle\") pod \"d0bac327-bee5-4f5d-9c01-449904ea027f\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " Jun 10 20:49:00.633652 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.633663 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btrfk\" (UniqueName: \"kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk\") pod \"d0bac327-bee5-4f5d-9c01-449904ea027f\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " Jun 10 20:49:00.634347 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.634323 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle" (OuterVolumeSpecName: "bundle") pod "d0bac327-bee5-4f5d-9c01-449904ea027f" (UID: "d0bac327-bee5-4f5d-9c01-449904ea027f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:00.635921 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.635900 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk" (OuterVolumeSpecName: "kube-api-access-btrfk") pod "d0bac327-bee5-4f5d-9c01-449904ea027f" (UID: "d0bac327-bee5-4f5d-9c01-449904ea027f"). InnerVolumeSpecName "kube-api-access-btrfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:49:00.734439 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.734341 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util\") pod \"d0bac327-bee5-4f5d-9c01-449904ea027f\" (UID: \"d0bac327-bee5-4f5d-9c01-449904ea027f\") " Jun 10 20:49:00.734629 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.734505 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:00.734629 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.734517 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btrfk\" (UniqueName: \"kubernetes.io/projected/d0bac327-bee5-4f5d-9c01-449904ea027f-kube-api-access-btrfk\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:00.738791 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.738763 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util" (OuterVolumeSpecName: "util") pod "d0bac327-bee5-4f5d-9c01-449904ea027f" (UID: "d0bac327-bee5-4f5d-9c01-449904ea027f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:00.835297 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:00.835251 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0bac327-bee5-4f5d-9c01-449904ea027f-util\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:01.464334 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:01.464301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" event={"ID":"d0bac327-bee5-4f5d-9c01-449904ea027f","Type":"ContainerDied","Data":"45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8"} Jun 10 20:49:01.464539 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:01.464340 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm7nb" Jun 10 20:49:01.464539 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:01.464348 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45644f018f445a4b8a7832281edd49cade52724d707b79f8208a52f0de40b8c8" Jun 10 20:49:08.690765 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.690728 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg"] Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.690981 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="extract" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.690991 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="extract" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.691008 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="util" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.691014 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="util" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.691024 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="pull" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.691029 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="pull" Jun 10 20:49:08.691189 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.691074 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0bac327-bee5-4f5d-9c01-449904ea027f" containerName="extract" Jun 10 20:49:08.695074 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.695057 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.697557 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.697535 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 20:49:08.697722 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.697566 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:49:08.697722 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.697577 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fwdgt\"" Jun 10 20:49:08.706902 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.706882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg"] Jun 10 20:49:08.784806 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.784758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphm7\" (UniqueName: \"kubernetes.io/projected/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-kube-api-access-tphm7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.784995 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.784821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.885187 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.885154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphm7\" (UniqueName: \"kubernetes.io/projected/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-kube-api-access-tphm7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.885361 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.885201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.885561 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.885544 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:08.896038 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:08.896004 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphm7\" (UniqueName: \"kubernetes.io/projected/c8e0a739-9528-43d1-9dfb-1e76de2ad38a-kube-api-access-tphm7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xcvlg\" (UID: \"c8e0a739-9528-43d1-9dfb-1e76de2ad38a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:09.003867 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:09.003825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" Jun 10 20:49:09.139074 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:09.139041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg"] Jun 10 20:49:09.143946 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:49:09.143920 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e0a739_9528_43d1_9dfb_1e76de2ad38a.slice/crio-77e1a23a56882673cdc4d622a04fa1681475742f1ccb9939364e806b86dec8cb WatchSource:0}: Error finding container 77e1a23a56882673cdc4d622a04fa1681475742f1ccb9939364e806b86dec8cb: Status 404 returned error can't find the container with id 77e1a23a56882673cdc4d622a04fa1681475742f1ccb9939364e806b86dec8cb Jun 10 20:49:09.494056 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:09.494020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" event={"ID":"c8e0a739-9528-43d1-9dfb-1e76de2ad38a","Type":"ContainerStarted","Data":"77e1a23a56882673cdc4d622a04fa1681475742f1ccb9939364e806b86dec8cb"} Jun 10 20:49:11.504644 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:11.504604 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" event={"ID":"c8e0a739-9528-43d1-9dfb-1e76de2ad38a","Type":"ContainerStarted","Data":"c79b91cd3970337fe95af06c3f6b0e003186c85c2b8506168e7f737304887888"} Jun 10 20:49:11.526869 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:11.526813 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xcvlg" podStartSLOduration=2.026810153 podStartE2EDuration="3.526796976s" totalImagesPullingTime="1.499986823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:11.524522196 +0000 UTC m=+425.993721055" watchObservedRunningTime="2026-06-10 20:49:11.526796976 +0000 UTC m=+425.995995835" Jun 10 20:49:16.828096 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.828052 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk"] Jun 10 20:49:16.830138 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.830122 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.832709 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.832672 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6v5fv\"" Jun 10 20:49:16.832832 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.832711 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 20:49:16.833564 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.833548 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 20:49:16.838707 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.838667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk"] Jun 10 20:49:16.845640 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.845588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwnj\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-kube-api-access-kdwnj\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.845767 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.845703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.947098 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.947058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwnj\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-kube-api-access-kdwnj\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.947098 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.947104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.956213 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.956187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:16.956338 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:16.956245 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwnj\" (UniqueName: \"kubernetes.io/projected/d7c1b1e5-46e2-405a-a25a-43aff39a221c-kube-api-access-kdwnj\") pod \"cert-manager-cainjector-5d99449ffd-h8dbk\" (UID: \"d7c1b1e5-46e2-405a-a25a-43aff39a221c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:17.152817 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:17.152731 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" Jun 10 20:49:17.286879 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:17.286851 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk"] Jun 10 20:49:17.289222 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:49:17.289194 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7c1b1e5_46e2_405a_a25a_43aff39a221c.slice/crio-aacd97b42ba34be745aeef6e510ee6159295846901e6c65316f9baa40456b3d3 WatchSource:0}: Error finding container aacd97b42ba34be745aeef6e510ee6159295846901e6c65316f9baa40456b3d3: Status 404 returned error can't find the container with id aacd97b42ba34be745aeef6e510ee6159295846901e6c65316f9baa40456b3d3 Jun 10 20:49:17.528212 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:17.528174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" event={"ID":"d7c1b1e5-46e2-405a-a25a-43aff39a221c","Type":"ContainerStarted","Data":"aacd97b42ba34be745aeef6e510ee6159295846901e6c65316f9baa40456b3d3"} Jun 10 20:49:20.542387 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:20.542352 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" event={"ID":"d7c1b1e5-46e2-405a-a25a-43aff39a221c","Type":"ContainerStarted","Data":"507945a88a4bcf9db7cbe9205d44ef378a42bb1c80a8c1c1c66ea26ad70595ab"} Jun 10 20:49:20.562612 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:20.562563 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-h8dbk" podStartSLOduration=2.079409444 podStartE2EDuration="4.562548412s" totalImagesPullingTime="2.483138968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:20.562198607 +0000 UTC m=+435.031397468" watchObservedRunningTime="2026-06-10 20:49:20.562548412 +0000 UTC m=+435.031747270" Jun 10 20:49:50.420923 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.420884 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m"] Jun 10 20:49:50.425472 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.425455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.428214 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.428194 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:49:50.429171 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.429152 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:49:50.429232 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.429154 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:49:50.432090 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.432060 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m"] Jun 10 20:49:50.520632 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.520594 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.520632 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.520633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjsg\" (UniqueName: \"kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.520874 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.520721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.621693 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.621643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.621891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.621724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjsg\" (UniqueName: \"kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.621891 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.621798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.622067 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.622049 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.622132 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.622113 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.630300 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.630270 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjsg\" (UniqueName: \"kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.736179 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.736144 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:50.874728 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:50.874702 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m"] Jun 10 20:49:50.877350 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:49:50.877321 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2616f01_93dd_4fc5_aa35_e8bd8069f61f.slice/crio-78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229 WatchSource:0}: Error finding container 78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229: Status 404 returned error can't find the container with id 78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229 Jun 10 20:49:51.673254 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:51.673221 2582 generic.go:356] "Generic (PLEG): container finished" podID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerID="74cc3db887e68eb128e8bfa3348b98c1303d2e855a89e81c6fd96aab5c94a6d6" exitCode=0 Jun 10 20:49:51.673569 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:51.673271 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" event={"ID":"e2616f01-93dd-4fc5-aa35-e8bd8069f61f","Type":"ContainerDied","Data":"74cc3db887e68eb128e8bfa3348b98c1303d2e855a89e81c6fd96aab5c94a6d6"} Jun 10 20:49:51.673569 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:51.673326 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" event={"ID":"e2616f01-93dd-4fc5-aa35-e8bd8069f61f","Type":"ContainerStarted","Data":"78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229"} Jun 10 20:49:52.678938 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.678857 2582 generic.go:356] "Generic (PLEG): container finished" podID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerID="eb06660e1e5dbc404e88f1684d70fa4dea6bf7b7b48ff62b7ae4f00ef3066c51" exitCode=0 Jun 10 20:49:52.679280 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.678940 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" event={"ID":"e2616f01-93dd-4fc5-aa35-e8bd8069f61f","Type":"ContainerDied","Data":"eb06660e1e5dbc404e88f1684d70fa4dea6bf7b7b48ff62b7ae4f00ef3066c51"} Jun 10 20:49:52.843864 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.843838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd"] Jun 10 20:49:52.845906 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.845891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:52.848784 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.848760 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 20:49:52.848955 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.848936 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 20:49:52.849032 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.848938 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 20:49:52.849032 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.849022 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwtbh\"" Jun 10 20:49:52.849173 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.849157 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 20:49:52.849279 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.849264 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:49:52.856741 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.856718 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd"] Jun 10 20:49:52.942010 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.941933 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81930013-c649-46dc-a980-a1dd5f6daea5-manager-config\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:52.942010 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.941972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-metrics-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:52.942010 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.941998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:52.942211 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:52.942044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkn7w\" (UniqueName: \"kubernetes.io/projected/81930013-c649-46dc-a980-a1dd5f6daea5-kube-api-access-jkn7w\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.042671 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.042614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81930013-c649-46dc-a980-a1dd5f6daea5-manager-config\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.042671 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.042675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-metrics-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.042906 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.042722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.042906 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.042739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkn7w\" (UniqueName: \"kubernetes.io/projected/81930013-c649-46dc-a980-a1dd5f6daea5-kube-api-access-jkn7w\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.043334 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.043297 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81930013-c649-46dc-a980-a1dd5f6daea5-manager-config\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.045447 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.045423 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-metrics-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.045555 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.045421 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81930013-c649-46dc-a980-a1dd5f6daea5-cert\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.052491 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.052465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkn7w\" (UniqueName: \"kubernetes.io/projected/81930013-c649-46dc-a980-a1dd5f6daea5-kube-api-access-jkn7w\") pod \"lws-controller-manager-678cf7c548-lnnpd\" (UID: \"81930013-c649-46dc-a980-a1dd5f6daea5\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.186032 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.185992 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:49:53.317054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.317031 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd"] Jun 10 20:49:53.319344 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:49:53.319315 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81930013_c649_46dc_a980_a1dd5f6daea5.slice/crio-512dd11c7a80d641b7bce30c74f94fe806ea979484a4990f04034a0ab41da366 WatchSource:0}: Error finding container 512dd11c7a80d641b7bce30c74f94fe806ea979484a4990f04034a0ab41da366: Status 404 returned error can't find the container with id 512dd11c7a80d641b7bce30c74f94fe806ea979484a4990f04034a0ab41da366 Jun 10 20:49:53.684117 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.684073 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" event={"ID":"81930013-c649-46dc-a980-a1dd5f6daea5","Type":"ContainerStarted","Data":"512dd11c7a80d641b7bce30c74f94fe806ea979484a4990f04034a0ab41da366"} Jun 10 20:49:53.686093 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.686063 2582 generic.go:356] "Generic (PLEG): container finished" podID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerID="24842a61a8848f5d512df2247b929d248acee6ab3127cba232df8b0b413e9d12" exitCode=0 Jun 10 20:49:53.686200 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:53.686112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" event={"ID":"e2616f01-93dd-4fc5-aa35-e8bd8069f61f","Type":"ContainerDied","Data":"24842a61a8848f5d512df2247b929d248acee6ab3127cba232df8b0b413e9d12"} Jun 10 20:49:54.814644 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.814621 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:49:54.958577 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.958544 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmjsg\" (UniqueName: \"kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg\") pod \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " Jun 10 20:49:54.958745 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.958612 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util\") pod \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " Jun 10 20:49:54.958745 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.958637 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle\") pod \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\" (UID: \"e2616f01-93dd-4fc5-aa35-e8bd8069f61f\") " Jun 10 20:49:54.959362 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.959334 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle" (OuterVolumeSpecName: "bundle") pod "e2616f01-93dd-4fc5-aa35-e8bd8069f61f" (UID: "e2616f01-93dd-4fc5-aa35-e8bd8069f61f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:54.960943 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.960908 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg" (OuterVolumeSpecName: "kube-api-access-xmjsg") pod "e2616f01-93dd-4fc5-aa35-e8bd8069f61f" (UID: "e2616f01-93dd-4fc5-aa35-e8bd8069f61f"). InnerVolumeSpecName "kube-api-access-xmjsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:49:54.964124 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:54.964093 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util" (OuterVolumeSpecName: "util") pod "e2616f01-93dd-4fc5-aa35-e8bd8069f61f" (UID: "e2616f01-93dd-4fc5-aa35-e8bd8069f61f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:55.059596 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.059559 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-util\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:55.059596 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.059589 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:55.059596 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.059599 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmjsg\" (UniqueName: \"kubernetes.io/projected/e2616f01-93dd-4fc5-aa35-e8bd8069f61f-kube-api-access-xmjsg\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:49:55.695659 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.695621 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" event={"ID":"e2616f01-93dd-4fc5-aa35-e8bd8069f61f","Type":"ContainerDied","Data":"78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229"} Jun 10 20:49:55.695908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.695698 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78b003fcfed998cdbf80bc8b4235ea2fc1a4a4b53fef99a392ad8385dada1229" Jun 10 20:49:55.695908 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:49:55.695629 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9v56m" Jun 10 20:50:02.110533 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110498 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg"] Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110791 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="extract" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110802 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="extract" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110811 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="util" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110816 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="util" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110829 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="pull" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110834 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="pull" Jun 10 20:50:02.110936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.110887 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2616f01-93dd-4fc5-aa35-e8bd8069f61f" containerName="extract" Jun 10 20:50:02.114170 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.114143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.116946 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.116925 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m4qdw\"" Jun 10 20:50:02.117423 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.117401 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 20:50:02.117541 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.117428 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 20:50:02.117541 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.117438 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 20:50:02.117695 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.117664 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 20:50:02.127936 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.127913 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg"] Jun 10 20:50:02.215301 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.215266 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.215301 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.215308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfk42\" (UniqueName: \"kubernetes.io/projected/3589057e-0fe9-4466-abc5-0f3ea3041622-kube-api-access-vfk42\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.215519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.215346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.215519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.215449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.215519 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.215481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.316653 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.316616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.316653 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.316655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.316918 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.316718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.316918 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.316738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfk42\" (UniqueName: \"kubernetes.io/projected/3589057e-0fe9-4466-abc5-0f3ea3041622-kube-api-access-vfk42\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.316918 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.316785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.317194 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.317172 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.319304 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.319275 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3589057e-0fe9-4466-abc5-0f3ea3041622-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.319400 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.319352 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.319400 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.319388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3589057e-0fe9-4466-abc5-0f3ea3041622-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.324927 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.324904 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfk42\" (UniqueName: \"kubernetes.io/projected/3589057e-0fe9-4466-abc5-0f3ea3041622-kube-api-access-vfk42\") pod \"opendatahub-operator-controller-manager-546b599574-gs9cg\" (UID: \"3589057e-0fe9-4466-abc5-0f3ea3041622\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.425394 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.425296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:02.566883 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.566856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg"] Jun 10 20:50:02.568930 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:50:02.568902 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3589057e_0fe9_4466_abc5_0f3ea3041622.slice/crio-0699f39fadd4e6afc88ed73f994f27ee7ca6dad261a2c8c7c00d53760b9615c5 WatchSource:0}: Error finding container 0699f39fadd4e6afc88ed73f994f27ee7ca6dad261a2c8c7c00d53760b9615c5: Status 404 returned error can't find the container with id 0699f39fadd4e6afc88ed73f994f27ee7ca6dad261a2c8c7c00d53760b9615c5 Jun 10 20:50:02.724835 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:02.724800 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" event={"ID":"3589057e-0fe9-4466-abc5-0f3ea3041622","Type":"ContainerStarted","Data":"0699f39fadd4e6afc88ed73f994f27ee7ca6dad261a2c8c7c00d53760b9615c5"} Jun 10 20:50:06.747617 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:06.747573 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" event={"ID":"3589057e-0fe9-4466-abc5-0f3ea3041622","Type":"ContainerStarted","Data":"dda37ccde8640113cd7b17c29d94742b6c3b54474544feffe2bdc83f388e6d98"} Jun 10 20:50:06.749089 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:06.749065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" event={"ID":"81930013-c649-46dc-a980-a1dd5f6daea5","Type":"ContainerStarted","Data":"2ea5fbca532281752c2a9f02961ba8169d5c92a76199e261b14e0a28e748f172"} Jun 10 20:50:06.749215 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:06.749193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:50:06.790764 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:06.790711 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" podStartSLOduration=1.499313469 podStartE2EDuration="14.790695445s" totalImagesPullingTime="13.291381976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:06.789625289 +0000 UTC m=+481.258824148" watchObservedRunningTime="2026-06-10 20:50:06.790695445 +0000 UTC m=+481.259894295" Jun 10 20:50:07.754828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:07.754792 2582 generic.go:356] "Generic (PLEG): container finished" podID="3589057e-0fe9-4466-abc5-0f3ea3041622" containerID="dda37ccde8640113cd7b17c29d94742b6c3b54474544feffe2bdc83f388e6d98" exitCode=0 Jun 10 20:50:07.755282 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:07.754887 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" event={"ID":"3589057e-0fe9-4466-abc5-0f3ea3041622","Type":"ContainerDied","Data":"dda37ccde8640113cd7b17c29d94742b6c3b54474544feffe2bdc83f388e6d98"} Jun 10 20:50:08.761793 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:08.761755 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" event={"ID":"3589057e-0fe9-4466-abc5-0f3ea3041622","Type":"ContainerStarted","Data":"825ec45f4ae50abce90b9c2ffb28002114ea3a939d1c182a26d2ee8071679fdf"} Jun 10 20:50:08.762252 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:08.761877 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:08.785498 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:08.785444 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" podStartSLOduration=1.511588994 podStartE2EDuration="6.785424741s" totalImagesPullingTime="4.279728339s" totalInitContainerRuntime="994.107408ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:08.78328492 +0000 UTC m=+483.252483778" watchObservedRunningTime="2026-06-10 20:50:08.785424741 +0000 UTC m=+483.254623600" Jun 10 20:50:17.757548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:17.757509 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-lnnpd" Jun 10 20:50:19.768642 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:19.768612 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-gs9cg" Jun 10 20:50:21.927439 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.927407 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp"] Jun 10 20:50:21.939958 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.939920 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp"] Jun 10 20:50:21.940114 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.940044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:21.942961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.942935 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 20:50:21.942961 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.942949 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m984s\"" Jun 10 20:50:21.943170 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.942962 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 20:50:21.964300 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.964275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:21.964428 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.964317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tmp\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:21.964428 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:21.964386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfxc\" (UniqueName: \"kubernetes.io/projected/26b5b7c2-967c-49e2-9eee-be83ba3a216f-kube-api-access-sgfxc\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.065548 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.065517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfxc\" (UniqueName: \"kubernetes.io/projected/26b5b7c2-967c-49e2-9eee-be83ba3a216f-kube-api-access-sgfxc\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.065746 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.065569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.065746 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.065617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tmp\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.065847 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:50:22.065754 2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.065847 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:50:22.065843 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs podName:26b5b7c2-967c-49e2-9eee-be83ba3a216f nodeName:}" failed. No retries permitted until 2026-06-10 20:50:22.565826824 +0000 UTC m=+497.035025661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs") pod "kube-auth-proxy-64cf7df7f-qdcvp" (UID: "26b5b7c2-967c-49e2-9eee-be83ba3a216f") : secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.068024 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.067965 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tmp\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.074616 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.074593 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfxc\" (UniqueName: \"kubernetes.io/projected/26b5b7c2-967c-49e2-9eee-be83ba3a216f-kube-api-access-sgfxc\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.570941 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:22.570907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:22.571187 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:50:22.571076 2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.571187 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:50:22.571153 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs podName:26b5b7c2-967c-49e2-9eee-be83ba3a216f nodeName:}" failed. No retries permitted until 2026-06-10 20:50:23.571134043 +0000 UTC m=+498.040332901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs") pod "kube-auth-proxy-64cf7df7f-qdcvp" (UID: "26b5b7c2-967c-49e2-9eee-be83ba3a216f") : secret "kube-auth-proxy-tls" not found Jun 10 20:50:23.579476 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:23.579436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:23.582175 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:23.582146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b5b7c2-967c-49e2-9eee-be83ba3a216f-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-qdcvp\" (UID: \"26b5b7c2-967c-49e2-9eee-be83ba3a216f\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:23.751580 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:23.751543 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" Jun 10 20:50:23.898695 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:23.898641 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp"] Jun 10 20:50:23.901741 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:50:23.901714 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b5b7c2_967c_49e2_9eee_be83ba3a216f.slice/crio-e6d4e4d41546013746910043b56efafff7f2af6c1377d52c4081f1920a3cc7cd WatchSource:0}: Error finding container e6d4e4d41546013746910043b56efafff7f2af6c1377d52c4081f1920a3cc7cd: Status 404 returned error can't find the container with id e6d4e4d41546013746910043b56efafff7f2af6c1377d52c4081f1920a3cc7cd Jun 10 20:50:24.836085 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:24.836032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" event={"ID":"26b5b7c2-967c-49e2-9eee-be83ba3a216f","Type":"ContainerStarted","Data":"e6d4e4d41546013746910043b56efafff7f2af6c1377d52c4081f1920a3cc7cd"} Jun 10 20:50:26.847658 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:26.847625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" event={"ID":"26b5b7c2-967c-49e2-9eee-be83ba3a216f","Type":"ContainerStarted","Data":"fe77b770bf4599d5ed3aface87c9fa4963675fcf63c576cb22ae3e3dd5c1aacf"} Jun 10 20:50:26.869129 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:50:26.864947 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-qdcvp" podStartSLOduration=3.133170186 podStartE2EDuration="5.864927572s" totalImagesPullingTime="2.731757386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:26.863590225 +0000 UTC m=+501.332789075" watchObservedRunningTime="2026-06-10 20:50:26.864927572 +0000 UTC m=+501.334126433" Jun 10 20:51:29.605301 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.605267 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f676c9cdc-fppk2"] Jun 10 20:51:29.607629 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.607608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.611385 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:29.611354 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-104.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-139-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 10 20:51:29.611500 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:29.611411 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-139-104.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-139-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" Jun 10 20:51:29.612313 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.612297 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 20:51:29.612761 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:29.612535 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-104.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-139-104.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 10 20:51:29.618993 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.618852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 20:51:29.619497 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.619332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 20:51:29.619497 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.619382 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d7cfp\"" Jun 10 20:51:29.619497 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.619387 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 20:51:29.622003 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.621973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 20:51:29.633099 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.633076 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f676c9cdc-fppk2"] Jun 10 20:51:29.707652 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.707840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707664 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-service-ca\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.707840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707710 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-oauth-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.707840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-oauth-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.707840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707803 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.707840 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-trusted-ca-bundle\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.708059 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.707880 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8fw\" (UniqueName: \"kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808294 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-service-ca\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808294 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-oauth-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-oauth-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-trusted-ca-bundle\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808508 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8fw\" (UniqueName: \"kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.808644 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.808519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.809121 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.809085 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-service-ca\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.809430 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.809217 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.809430 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.809347 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-trusted-ca-bundle\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.810859 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.810839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-oauth-config\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:29.810978 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:29.810961 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/651158c7-8c1d-44c0-8e9d-5726292d8fa1-console-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:30.602272 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:30.602239 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 20:51:30.726630 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:30.726603 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 20:51:30.729216 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:30.729195 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/651158c7-8c1d-44c0-8e9d-5726292d8fa1-oauth-serving-cert\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:30.815601 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:30.815566 2582 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 10 20:51:30.815746 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:30.815616 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bg8fw for pod openshift-console/console-6f676c9cdc-fppk2: failed to sync configmap cache: timed out waiting for the condition Jun 10 20:51:30.815746 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:51:30.815710 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw podName:651158c7-8c1d-44c0-8e9d-5726292d8fa1 nodeName:}" failed. No retries permitted until 2026-06-10 20:51:31.315665047 +0000 UTC m=+565.784863885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bg8fw" (UniqueName: "kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw") pod "console-6f676c9cdc-fppk2" (UID: "651158c7-8c1d-44c0-8e9d-5726292d8fa1") : failed to sync configmap cache: timed out waiting for the condition Jun 10 20:51:31.135191 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:31.135161 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 20:51:31.320459 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:31.320415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8fw\" (UniqueName: \"kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:31.323054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:31.323025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8fw\" (UniqueName: \"kubernetes.io/projected/651158c7-8c1d-44c0-8e9d-5726292d8fa1-kube-api-access-bg8fw\") pod \"console-6f676c9cdc-fppk2\" (UID: \"651158c7-8c1d-44c0-8e9d-5726292d8fa1\") " pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:31.421626 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:31.421525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:31.552795 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:31.552752 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f676c9cdc-fppk2"] Jun 10 20:51:31.555145 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:51:31.555118 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651158c7_8c1d_44c0_8e9d_5726292d8fa1.slice/crio-f1e2f6ae40fba32a5ac131a9b23fbcf174275a76e0fab38034b0a32beb8d980a WatchSource:0}: Error finding container f1e2f6ae40fba32a5ac131a9b23fbcf174275a76e0fab38034b0a32beb8d980a: Status 404 returned error can't find the container with id f1e2f6ae40fba32a5ac131a9b23fbcf174275a76e0fab38034b0a32beb8d980a Jun 10 20:51:32.133543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:32.133501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f676c9cdc-fppk2" event={"ID":"651158c7-8c1d-44c0-8e9d-5726292d8fa1","Type":"ContainerStarted","Data":"5fbf2dc7bb7b25298d94c5f45f1e2a6a62021383e72d11b5d11bd9cdaf2bca65"} Jun 10 20:51:32.133934 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:32.133558 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f676c9cdc-fppk2" event={"ID":"651158c7-8c1d-44c0-8e9d-5726292d8fa1","Type":"ContainerStarted","Data":"f1e2f6ae40fba32a5ac131a9b23fbcf174275a76e0fab38034b0a32beb8d980a"} Jun 10 20:51:32.155096 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:32.155047 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f676c9cdc-fppk2" podStartSLOduration=3.155031753 podStartE2EDuration="3.155031753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:51:32.153119065 +0000 UTC m=+566.622317924" watchObservedRunningTime="2026-06-10 20:51:32.155031753 +0000 UTC m=+566.624230612" Jun 10 20:51:38.232171 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.232133 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2"] Jun 10 20:51:38.235731 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.235714 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.238501 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.238469 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:51:38.238501 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.238484 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:51:38.239665 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.239649 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xmmbv\"" Jun 10 20:51:38.244147 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.244126 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2"] Jun 10 20:51:38.276860 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.276828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.277048 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.276880 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct592\" (UniqueName: \"kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.277048 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.276899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.378200 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.378154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.378375 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.378213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct592\" (UniqueName: \"kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.378375 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.378234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.378571 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.378551 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.378616 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.378591 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.388136 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.388114 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct592\" (UniqueName: \"kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.545501 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.545418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:38.682523 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:38.682492 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2"] Jun 10 20:51:38.684540 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:51:38.684505 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fda72bc_24f7_45b2_9149_bb6a656fb074.slice/crio-ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb WatchSource:0}: Error finding container ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb: Status 404 returned error can't find the container with id ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb Jun 10 20:51:39.030228 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.030197 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp"] Jun 10 20:51:39.033595 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.033574 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.043316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.043292 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp"] Jun 10 20:51:39.084696 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.084636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ttm\" (UniqueName: \"kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.084855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.084719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.084855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.084743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.170933 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.170893 2582 generic.go:356] "Generic (PLEG): container finished" podID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerID="d6ec8398f68896015fccbf6585ae6f4015ed719b771ed20e8a50c7d2572184da" exitCode=0 Jun 10 20:51:39.171092 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.170977 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" event={"ID":"8fda72bc-24f7-45b2-9149-bb6a656fb074","Type":"ContainerDied","Data":"d6ec8398f68896015fccbf6585ae6f4015ed719b771ed20e8a50c7d2572184da"} Jun 10 20:51:39.171092 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.171059 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" event={"ID":"8fda72bc-24f7-45b2-9149-bb6a656fb074","Type":"ContainerStarted","Data":"ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb"} Jun 10 20:51:39.185327 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.185300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ttm\" (UniqueName: \"kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.185465 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.185356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.185465 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.185384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.185834 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.185814 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.185886 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.185819 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.197589 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.197564 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ttm\" (UniqueName: \"kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.343981 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.343892 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:39.478035 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.477933 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp"] Jun 10 20:51:39.480605 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:51:39.480580 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fe641b_4649_45a3_b7fb_efdfdd17596b.slice/crio-cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb WatchSource:0}: Error finding container cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb: Status 404 returned error can't find the container with id cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb Jun 10 20:51:39.633782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.633706 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh"] Jun 10 20:51:39.637027 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.637011 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.646890 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.646868 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh"] Jun 10 20:51:39.690845 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.690812 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.691012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.690924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqkw\" (UniqueName: \"kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.691012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.690959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.792099 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.792048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.792301 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.792157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqkw\" (UniqueName: \"kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.792301 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.792198 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.792510 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.792483 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.792510 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.792501 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.804058 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.804022 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqkw\" (UniqueName: \"kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:39.946364 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:39.946292 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:40.084270 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.084235 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh"] Jun 10 20:51:40.088039 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:51:40.088012 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd589a8d8_54b3_44a5_98a7_5ef1cb590e4c.slice/crio-cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09 WatchSource:0}: Error finding container cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09: Status 404 returned error can't find the container with id cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09 Jun 10 20:51:40.178569 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.178531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerStarted","Data":"93682e8149f31c571c0748f8b5d4360eb8bc6806a7b7fa90f96217edc14b43da"} Jun 10 20:51:40.178769 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.178597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerStarted","Data":"cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09"} Jun 10 20:51:40.180129 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.180092 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerID="505cada2f3ed7a3d85be21de4a38945ffe150f8c00465c1728889312358425a1" exitCode=0 Jun 10 20:51:40.180249 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.180165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" event={"ID":"a5fe641b-4649-45a3-b7fb-efdfdd17596b","Type":"ContainerDied","Data":"505cada2f3ed7a3d85be21de4a38945ffe150f8c00465c1728889312358425a1"} Jun 10 20:51:40.180249 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.180212 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" event={"ID":"a5fe641b-4649-45a3-b7fb-efdfdd17596b","Type":"ContainerStarted","Data":"cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb"} Jun 10 20:51:40.182202 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.182178 2582 generic.go:356] "Generic (PLEG): container finished" podID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerID="f95f6782de8e042a0dc79134b002b91763ef6f45886600a5f43ceded9bba052d" exitCode=0 Jun 10 20:51:40.182310 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:40.182243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" event={"ID":"8fda72bc-24f7-45b2-9149-bb6a656fb074","Type":"ContainerDied","Data":"f95f6782de8e042a0dc79134b002b91763ef6f45886600a5f43ceded9bba052d"} Jun 10 20:51:41.188378 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.188347 2582 generic.go:356] "Generic (PLEG): container finished" podID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerID="93682e8149f31c571c0748f8b5d4360eb8bc6806a7b7fa90f96217edc14b43da" exitCode=0 Jun 10 20:51:41.188844 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.188427 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerDied","Data":"93682e8149f31c571c0748f8b5d4360eb8bc6806a7b7fa90f96217edc14b43da"} Jun 10 20:51:41.190269 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.190247 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerID="d250733bbe831e20dea4b3415d2baa207a7110fa992a19224863c63a008c6143" exitCode=0 Jun 10 20:51:41.190388 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.190322 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" event={"ID":"a5fe641b-4649-45a3-b7fb-efdfdd17596b","Type":"ContainerDied","Data":"d250733bbe831e20dea4b3415d2baa207a7110fa992a19224863c63a008c6143"} Jun 10 20:51:41.192569 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.192548 2582 generic.go:356] "Generic (PLEG): container finished" podID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerID="9949f1c3bac6433f93642825ea46922ec015f40e5bc0f3e216b2a954054fde30" exitCode=0 Jun 10 20:51:41.192783 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.192596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" event={"ID":"8fda72bc-24f7-45b2-9149-bb6a656fb074","Type":"ContainerDied","Data":"9949f1c3bac6433f93642825ea46922ec015f40e5bc0f3e216b2a954054fde30"} Jun 10 20:51:41.422755 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.422713 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:41.422919 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.422787 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:41.427569 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:41.427544 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:42.200180 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.200143 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerID="d062aac2257f130a5b8f3d64fef3e712009ba79ab2ffd4a8e28e4d56c2d9d589" exitCode=0 Jun 10 20:51:42.200589 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.200227 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" event={"ID":"a5fe641b-4649-45a3-b7fb-efdfdd17596b","Type":"ContainerDied","Data":"d062aac2257f130a5b8f3d64fef3e712009ba79ab2ffd4a8e28e4d56c2d9d589"} Jun 10 20:51:42.201947 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.201926 2582 generic.go:356] "Generic (PLEG): container finished" podID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerID="917dcd99a187ccd9a2570051228605199e93976739db9efb0f8350b492b6c13f" exitCode=0 Jun 10 20:51:42.202064 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.201946 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerDied","Data":"917dcd99a187ccd9a2570051228605199e93976739db9efb0f8350b492b6c13f"} Jun 10 20:51:42.206804 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.206781 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f676c9cdc-fppk2" Jun 10 20:51:42.350954 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.350926 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:42.416872 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.416844 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util\") pod \"8fda72bc-24f7-45b2-9149-bb6a656fb074\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " Jun 10 20:51:42.417015 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.416892 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct592\" (UniqueName: \"kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592\") pod \"8fda72bc-24f7-45b2-9149-bb6a656fb074\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " Jun 10 20:51:42.417015 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.416937 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle\") pod \"8fda72bc-24f7-45b2-9149-bb6a656fb074\" (UID: \"8fda72bc-24f7-45b2-9149-bb6a656fb074\") " Jun 10 20:51:42.417403 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.417377 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle" (OuterVolumeSpecName: "bundle") pod "8fda72bc-24f7-45b2-9149-bb6a656fb074" (UID: "8fda72bc-24f7-45b2-9149-bb6a656fb074"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:42.419194 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.419174 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592" (OuterVolumeSpecName: "kube-api-access-ct592") pod "8fda72bc-24f7-45b2-9149-bb6a656fb074" (UID: "8fda72bc-24f7-45b2-9149-bb6a656fb074"). InnerVolumeSpecName "kube-api-access-ct592". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:51:42.422426 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.422392 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util" (OuterVolumeSpecName: "util") pod "8fda72bc-24f7-45b2-9149-bb6a656fb074" (UID: "8fda72bc-24f7-45b2-9149-bb6a656fb074"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:42.518455 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.518366 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct592\" (UniqueName: \"kubernetes.io/projected/8fda72bc-24f7-45b2-9149-bb6a656fb074-kube-api-access-ct592\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:42.518455 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.518399 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:42.518455 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:42.518414 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fda72bc-24f7-45b2-9149-bb6a656fb074-util\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:43.209930 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.209896 2582 generic.go:356] "Generic (PLEG): container finished" podID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerID="f7fca2f3a18a91163b0e22b6fda2d29e501a2c370ff6ed202d1d5f66911eb522" exitCode=0 Jun 10 20:51:43.210351 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.209965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerDied","Data":"f7fca2f3a18a91163b0e22b6fda2d29e501a2c370ff6ed202d1d5f66911eb522"} Jun 10 20:51:43.211898 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.211876 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" Jun 10 20:51:43.212001 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.211896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2" event={"ID":"8fda72bc-24f7-45b2-9149-bb6a656fb074","Type":"ContainerDied","Data":"ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb"} Jun 10 20:51:43.212001 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.211934 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebcc3b3de5a36d5f026a4834fb90ea1f673973f9642de378fe4cea5802974bdb" Jun 10 20:51:43.337910 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.337886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:43.425033 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.425000 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle\") pod \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " Jun 10 20:51:43.425175 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.425054 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util\") pod \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " Jun 10 20:51:43.425175 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.425105 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5ttm\" (UniqueName: \"kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm\") pod \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\" (UID: \"a5fe641b-4649-45a3-b7fb-efdfdd17596b\") " Jun 10 20:51:43.425782 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.425740 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle" (OuterVolumeSpecName: "bundle") pod "a5fe641b-4649-45a3-b7fb-efdfdd17596b" (UID: "a5fe641b-4649-45a3-b7fb-efdfdd17596b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:43.427243 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.427209 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm" (OuterVolumeSpecName: "kube-api-access-l5ttm") pod "a5fe641b-4649-45a3-b7fb-efdfdd17596b" (UID: "a5fe641b-4649-45a3-b7fb-efdfdd17596b"). InnerVolumeSpecName "kube-api-access-l5ttm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:51:43.430761 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.430742 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util" (OuterVolumeSpecName: "util") pod "a5fe641b-4649-45a3-b7fb-efdfdd17596b" (UID: "a5fe641b-4649-45a3-b7fb-efdfdd17596b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:43.526316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.526232 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5ttm\" (UniqueName: \"kubernetes.io/projected/a5fe641b-4649-45a3-b7fb-efdfdd17596b-kube-api-access-l5ttm\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:43.526316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.526261 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:43.526316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:43.526270 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5fe641b-4649-45a3-b7fb-efdfdd17596b-util\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:44.219012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.218966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" event={"ID":"a5fe641b-4649-45a3-b7fb-efdfdd17596b","Type":"ContainerDied","Data":"cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb"} Jun 10 20:51:44.219012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.218990 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp" Jun 10 20:51:44.219417 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.219026 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb6335c77613498fd1959c1941419f2c04f157c0ff59b391010017db4a57c6eb" Jun 10 20:51:44.346918 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.346890 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:44.434460 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.434419 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzqkw\" (UniqueName: \"kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw\") pod \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " Jun 10 20:51:44.434631 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.434474 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle\") pod \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " Jun 10 20:51:44.434631 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.434502 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util\") pod \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\" (UID: \"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c\") " Jun 10 20:51:44.435090 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.435063 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle" (OuterVolumeSpecName: "bundle") pod "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" (UID: "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:44.436765 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.436730 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw" (OuterVolumeSpecName: "kube-api-access-tzqkw") pod "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" (UID: "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c"). InnerVolumeSpecName "kube-api-access-tzqkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:51:44.439901 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.439864 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util" (OuterVolumeSpecName: "util") pod "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" (UID: "d589a8d8-54b3-44a5-98a7-5ef1cb590e4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:44.535837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.535798 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-bundle\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:44.535837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.535829 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-util\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:44.535837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:44.535840 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzqkw\" (UniqueName: \"kubernetes.io/projected/d589a8d8-54b3-44a5-98a7-5ef1cb590e4c-kube-api-access-tzqkw\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:51:45.228866 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:45.228831 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" Jun 10 20:51:45.228866 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:45.228845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh" event={"ID":"d589a8d8-54b3-44a5-98a7-5ef1cb590e4c","Type":"ContainerDied","Data":"cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09"} Jun 10 20:51:45.229344 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:51:45.228890 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc8ef36889d7d31b0d3b7b071b98118c3ad3e7c9f7f0d2569da4268c73403d09" Jun 10 20:52:06.004090 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:06.004048 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:52:06.004649 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:06.004296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:52:12.746822 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.746787 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whdqv"] Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747083 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747093 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747101 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747108 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747123 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747131 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747142 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747148 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747155 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747164 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747172 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747180 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747193 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747198 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="pull" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747206 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747212 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="util" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747221 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747225 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747285 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fda72bc-24f7-45b2-9149-bb6a656fb074" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747294 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fe641b-4649-45a3-b7fb-efdfdd17596b" containerName="extract" Jun 10 20:52:12.749012 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.747301 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d589a8d8-54b3-44a5-98a7-5ef1cb590e4c" containerName="extract" Jun 10 20:52:12.749847 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.749830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:12.752614 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.752593 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:52:12.752750 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.752610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h2pdg\"" Jun 10 20:52:12.752750 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.752612 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:52:12.758737 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.758711 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whdqv"] Jun 10 20:52:12.874578 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.874538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kpqg\" (UniqueName: \"kubernetes.io/projected/1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9-kube-api-access-7kpqg\") pod \"authorino-operator-75cc8d5cb7-whdqv\" (UID: \"1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:12.975753 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.975710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpqg\" (UniqueName: \"kubernetes.io/projected/1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9-kube-api-access-7kpqg\") pod \"authorino-operator-75cc8d5cb7-whdqv\" (UID: \"1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:12.985327 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:12.985298 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kpqg\" (UniqueName: \"kubernetes.io/projected/1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9-kube-api-access-7kpqg\") pod \"authorino-operator-75cc8d5cb7-whdqv\" (UID: \"1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:13.060855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:13.060762 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:13.197044 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:13.197014 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-whdqv"] Jun 10 20:52:13.199861 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:52:13.199836 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c4de4_b4b7_4f19_9379_d4c5fbe3f7c9.slice/crio-ecf3716aeb87f6f199ece130143c0e153229905913b61bdcdb1dc659a843c4c2 WatchSource:0}: Error finding container ecf3716aeb87f6f199ece130143c0e153229905913b61bdcdb1dc659a843c4c2: Status 404 returned error can't find the container with id ecf3716aeb87f6f199ece130143c0e153229905913b61bdcdb1dc659a843c4c2 Jun 10 20:52:13.355714 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:13.355618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" event={"ID":"1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9","Type":"ContainerStarted","Data":"ecf3716aeb87f6f199ece130143c0e153229905913b61bdcdb1dc659a843c4c2"} Jun 10 20:52:15.369190 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:15.369148 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" event={"ID":"1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9","Type":"ContainerStarted","Data":"62d9d972e94df32a588acdba3a961c45ba5afb3a6152153d487efd99bc14c40c"} Jun 10 20:52:15.369649 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:15.369280 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:52:15.386962 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:15.386905 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" podStartSLOduration=1.327000986 podStartE2EDuration="3.386891429s" totalImagesPullingTime="2.059890443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:15.384905097 +0000 UTC m=+609.854103964" watchObservedRunningTime="2026-06-10 20:52:15.386891429 +0000 UTC m=+609.856090288" Jun 10 20:52:26.376726 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:52:26.376624 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-whdqv" Jun 10 20:53:14.088566 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.088528 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:53:14.091765 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.091747 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.094348 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.094326 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xmmbv\"" Jun 10 20:53:14.094462 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.094332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 20:53:14.100104 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.100079 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:53:14.129745 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.129714 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:53:14.182586 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.182558 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rtn\" (UniqueName: \"kubernetes.io/projected/569c3915-2a52-4d03-aba3-6fe9a96424da-kube-api-access-j6rtn\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.182774 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.182605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/569c3915-2a52-4d03-aba3-6fe9a96424da-config-file\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.283648 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.283611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/569c3915-2a52-4d03-aba3-6fe9a96424da-config-file\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.283886 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.283803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rtn\" (UniqueName: \"kubernetes.io/projected/569c3915-2a52-4d03-aba3-6fe9a96424da-kube-api-access-j6rtn\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.284335 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.284315 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/569c3915-2a52-4d03-aba3-6fe9a96424da-config-file\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.292986 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.292963 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rtn\" (UniqueName: \"kubernetes.io/projected/569c3915-2a52-4d03-aba3-6fe9a96424da-kube-api-access-j6rtn\") pod \"limitador-limitador-54d6d988d5-dbrjb\" (UID: \"569c3915-2a52-4d03-aba3-6fe9a96424da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.403324 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.403228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:14.535722 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.535696 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:53:14.538210 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:53:14.538186 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569c3915_2a52_4d03_aba3_6fe9a96424da.slice/crio-a0855e155ef55d9e529452bb1de266e03db7a4ae6611ccfd5e96e3eb84151973 WatchSource:0}: Error finding container a0855e155ef55d9e529452bb1de266e03db7a4ae6611ccfd5e96e3eb84151973: Status 404 returned error can't find the container with id a0855e155ef55d9e529452bb1de266e03db7a4ae6611ccfd5e96e3eb84151973 Jun 10 20:53:14.595298 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.595264 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:14.600079 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.600049 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:14.603107 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.603081 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r9jp8\"" Jun 10 20:53:14.603576 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.603555 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:14.645360 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.645312 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" event={"ID":"569c3915-2a52-4d03-aba3-6fe9a96424da","Type":"ContainerStarted","Data":"a0855e155ef55d9e529452bb1de266e03db7a4ae6611ccfd5e96e3eb84151973"} Jun 10 20:53:14.687072 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.686983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmn5g\" (UniqueName: \"kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g\") pod \"authorino-58cd955675-mhk6r\" (UID: \"a83917fa-e89c-4feb-bbec-d464f9c3d505\") " pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:14.788357 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.788312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmn5g\" (UniqueName: \"kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g\") pod \"authorino-58cd955675-mhk6r\" (UID: \"a83917fa-e89c-4feb-bbec-d464f9c3d505\") " pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:14.797971 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.797939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmn5g\" (UniqueName: \"kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g\") pod \"authorino-58cd955675-mhk6r\" (UID: \"a83917fa-e89c-4feb-bbec-d464f9c3d505\") " pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:14.911346 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:14.911306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:15.061409 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:15.061379 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:15.064022 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:53:15.063863 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda83917fa_e89c_4feb_bbec_d464f9c3d505.slice/crio-383f282e7c0ccf4ee9f861d5310bd4040cb6d1098557a712df6642c413e3d172 WatchSource:0}: Error finding container 383f282e7c0ccf4ee9f861d5310bd4040cb6d1098557a712df6642c413e3d172: Status 404 returned error can't find the container with id 383f282e7c0ccf4ee9f861d5310bd4040cb6d1098557a712df6642c413e3d172 Jun 10 20:53:15.652529 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:15.652482 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhk6r" event={"ID":"a83917fa-e89c-4feb-bbec-d464f9c3d505","Type":"ContainerStarted","Data":"383f282e7c0ccf4ee9f861d5310bd4040cb6d1098557a712df6642c413e3d172"} Jun 10 20:53:19.222670 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.222636 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:19.677398 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.677304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" event={"ID":"569c3915-2a52-4d03-aba3-6fe9a96424da","Type":"ContainerStarted","Data":"d64eaf0dfaa85d6a4f4e0613e63629537e16c815f05325c020fe048a668f1890"} Jun 10 20:53:19.677398 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.677362 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:53:19.678823 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.678799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhk6r" event={"ID":"a83917fa-e89c-4feb-bbec-d464f9c3d505","Type":"ContainerStarted","Data":"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a"} Jun 10 20:53:19.712991 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.712938 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" podStartSLOduration=1.321026322 podStartE2EDuration="5.712921437s" totalImagesPullingTime="4.391895115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:19.710518146 +0000 UTC m=+674.179717005" watchObservedRunningTime="2026-06-10 20:53:19.712921437 +0000 UTC m=+674.182120295" Jun 10 20:53:19.731232 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:19.731189 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mhk6r" podStartSLOduration=1.865902931 podStartE2EDuration="5.731172044s" totalImagesPullingTime="3.865269113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:19.728938686 +0000 UTC m=+674.198137545" watchObservedRunningTime="2026-06-10 20:53:19.731172044 +0000 UTC m=+674.200370904" Jun 10 20:53:20.683768 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:20.683730 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mhk6r" podUID="a83917fa-e89c-4feb-bbec-d464f9c3d505" containerName="authorino" containerID="cri-o://e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a" gracePeriod=30 Jun 10 20:53:20.932752 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:20.932716 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:21.044841 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.044807 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmn5g\" (UniqueName: \"kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g\") pod \"a83917fa-e89c-4feb-bbec-d464f9c3d505\" (UID: \"a83917fa-e89c-4feb-bbec-d464f9c3d505\") " Jun 10 20:53:21.047038 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.047014 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g" (OuterVolumeSpecName: "kube-api-access-rmn5g") pod "a83917fa-e89c-4feb-bbec-d464f9c3d505" (UID: "a83917fa-e89c-4feb-bbec-d464f9c3d505"). InnerVolumeSpecName "kube-api-access-rmn5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:53:21.145513 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.145483 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmn5g\" (UniqueName: \"kubernetes.io/projected/a83917fa-e89c-4feb-bbec-d464f9c3d505-kube-api-access-rmn5g\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:53:21.689864 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.689824 2582 generic.go:356] "Generic (PLEG): container finished" podID="a83917fa-e89c-4feb-bbec-d464f9c3d505" containerID="e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a" exitCode=0 Jun 10 20:53:21.690336 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.689886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mhk6r" Jun 10 20:53:21.690336 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.689912 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhk6r" event={"ID":"a83917fa-e89c-4feb-bbec-d464f9c3d505","Type":"ContainerDied","Data":"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a"} Jun 10 20:53:21.690336 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.689956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mhk6r" event={"ID":"a83917fa-e89c-4feb-bbec-d464f9c3d505","Type":"ContainerDied","Data":"383f282e7c0ccf4ee9f861d5310bd4040cb6d1098557a712df6642c413e3d172"} Jun 10 20:53:21.690336 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.689973 2582 scope.go:117] "RemoveContainer" containerID="e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a" Jun 10 20:53:21.698706 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.698665 2582 scope.go:117] "RemoveContainer" containerID="e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a" Jun 10 20:53:21.698959 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:53:21.698941 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a\": container with ID starting with e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a not found: ID does not exist" containerID="e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a" Jun 10 20:53:21.699016 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.698968 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a"} err="failed to get container status \"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a\": rpc error: code = NotFound desc = could not find container \"e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a\": container with ID starting with e3637c5a46c0bd1795a39b783e39c375a3a1f076e5138300bc38af4d1912368a not found: ID does not exist" Jun 10 20:53:21.711604 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.711581 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:21.713307 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:21.713288 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mhk6r"] Jun 10 20:53:22.018837 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:22.018803 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83917fa-e89c-4feb-bbec-d464f9c3d505" path="/var/lib/kubelet/pods/a83917fa-e89c-4feb-bbec-d464f9c3d505/volumes" Jun 10 20:53:30.684509 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:53:30.684475 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dbrjb" Jun 10 20:54:38.522356 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.522322 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:38.522828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.522641 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83917fa-e89c-4feb-bbec-d464f9c3d505" containerName="authorino" Jun 10 20:54:38.522828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.522652 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83917fa-e89c-4feb-bbec-d464f9c3d505" containerName="authorino" Jun 10 20:54:38.522828 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.522718 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a83917fa-e89c-4feb-bbec-d464f9c3d505" containerName="authorino" Jun 10 20:54:38.525500 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.525484 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:38.528229 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.528198 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r9jp8\"" Jun 10 20:54:38.531462 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.531438 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:38.610646 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.610608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mh9\" (UniqueName: \"kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9\") pod \"authorino-5d4b67c446-9tvkm\" (UID: \"d442a2d2-75cf-4313-8dff-e07649c115ee\") " pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:38.711219 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.711181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mh9\" (UniqueName: \"kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9\") pod \"authorino-5d4b67c446-9tvkm\" (UID: \"d442a2d2-75cf-4313-8dff-e07649c115ee\") " pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:38.719821 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.719793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mh9\" (UniqueName: \"kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9\") pod \"authorino-5d4b67c446-9tvkm\" (UID: \"d442a2d2-75cf-4313-8dff-e07649c115ee\") " pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:38.745316 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.745283 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:38.745543 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.745531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:38.766764 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.766732 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6755d97bb-24dmx"] Jun 10 20:54:38.770183 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.770163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:38.777994 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.777967 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6755d97bb-24dmx"] Jun 10 20:54:38.865975 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.865940 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6755d97bb-24dmx"] Jun 10 20:54:38.866213 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:54:38.866191 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wmvz2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6755d97bb-24dmx" podUID="8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6" Jun 10 20:54:38.878713 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.878643 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:38.881075 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:54:38.881046 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd442a2d2_75cf_4313_8dff_e07649c115ee.slice/crio-ad0fcddd2d947a383c568638a779c6dd0e8de0c2c402fc674442ceb62a23aa5d WatchSource:0}: Error finding container ad0fcddd2d947a383c568638a779c6dd0e8de0c2c402fc674442ceb62a23aa5d: Status 404 returned error can't find the container with id ad0fcddd2d947a383c568638a779c6dd0e8de0c2c402fc674442ceb62a23aa5d Jun 10 20:54:38.882374 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.882360 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:54:38.894866 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.894838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:54:38.898317 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.898298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:38.900895 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.900878 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 20:54:38.906421 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.906397 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:54:38.912807 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:38.912787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvz2\" (UniqueName: \"kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2\") pod \"authorino-6755d97bb-24dmx\" (UID: \"8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6\") " pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:39.013601 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.013557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.013812 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.013730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4t5\" (UniqueName: \"kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.013812 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.013774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvz2\" (UniqueName: \"kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2\") pod \"authorino-6755d97bb-24dmx\" (UID: \"8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6\") " pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:39.022871 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.022846 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvz2\" (UniqueName: \"kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2\") pod \"authorino-6755d97bb-24dmx\" (UID: \"8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6\") " pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:39.074359 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.074284 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:39.074359 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.074283 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" event={"ID":"d442a2d2-75cf-4313-8dff-e07649c115ee","Type":"ContainerStarted","Data":"ad0fcddd2d947a383c568638a779c6dd0e8de0c2c402fc674442ceb62a23aa5d"} Jun 10 20:54:39.081582 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.081561 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:39.115110 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.115078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4t5\" (UniqueName: \"kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.115110 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.115114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.117724 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.117673 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.123574 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.123541 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4t5\" (UniqueName: \"kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5\") pod \"authorino-86d98c589d-cgqhn\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.208612 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.208575 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:54:39.215610 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.215591 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmvz2\" (UniqueName: \"kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2\") pod \"8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6\" (UID: \"8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6\") " Jun 10 20:54:39.217916 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.217880 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2" (OuterVolumeSpecName: "kube-api-access-wmvz2") pod "8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6" (UID: "8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6"). InnerVolumeSpecName "kube-api-access-wmvz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:54:39.316327 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.316288 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmvz2\" (UniqueName: \"kubernetes.io/projected/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6-kube-api-access-wmvz2\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:54:39.357178 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:39.357141 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:54:40.080777 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.080738 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" event={"ID":"d442a2d2-75cf-4313-8dff-e07649c115ee","Type":"ContainerStarted","Data":"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f"} Jun 10 20:54:40.080777 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.080770 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" podUID="d442a2d2-75cf-4313-8dff-e07649c115ee" containerName="authorino" containerID="cri-o://5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f" gracePeriod=30 Jun 10 20:54:40.082289 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.082271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6755d97bb-24dmx" Jun 10 20:54:40.082289 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.082275 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d98c589d-cgqhn" event={"ID":"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc","Type":"ContainerStarted","Data":"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060"} Jun 10 20:54:40.082471 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.082309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d98c589d-cgqhn" event={"ID":"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc","Type":"ContainerStarted","Data":"45e92fadf2c8a1c6cc9ae03b561f8faef92cd71f42c8a78a6cf8c5f31f1abb07"} Jun 10 20:54:40.098250 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.098208 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" podStartSLOduration=1.748221326 podStartE2EDuration="2.098192827s" totalImagesPullingTime="349.971501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:54:40.096545674 +0000 UTC m=+754.565744534" watchObservedRunningTime="2026-06-10 20:54:40.098192827 +0000 UTC m=+754.567391685" Jun 10 20:54:40.115839 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.115787 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86d98c589d-cgqhn" podStartSLOduration=1.709530659 podStartE2EDuration="2.115771799s" totalImagesPullingTime="406.24114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:54:40.114203511 +0000 UTC m=+754.583402370" watchObservedRunningTime="2026-06-10 20:54:40.115771799 +0000 UTC m=+754.584970659" Jun 10 20:54:40.140415 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.140359 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6755d97bb-24dmx"] Jun 10 20:54:40.150764 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.150735 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6755d97bb-24dmx"] Jun 10 20:54:40.308644 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.308617 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:40.424660 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.424628 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4mh9\" (UniqueName: \"kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9\") pod \"d442a2d2-75cf-4313-8dff-e07649c115ee\" (UID: \"d442a2d2-75cf-4313-8dff-e07649c115ee\") " Jun 10 20:54:40.426865 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.426832 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9" (OuterVolumeSpecName: "kube-api-access-f4mh9") pod "d442a2d2-75cf-4313-8dff-e07649c115ee" (UID: "d442a2d2-75cf-4313-8dff-e07649c115ee"). InnerVolumeSpecName "kube-api-access-f4mh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:54:40.525659 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:40.525624 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4mh9\" (UniqueName: \"kubernetes.io/projected/d442a2d2-75cf-4313-8dff-e07649c115ee-kube-api-access-f4mh9\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:54:41.088912 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.088822 2582 generic.go:356] "Generic (PLEG): container finished" podID="d442a2d2-75cf-4313-8dff-e07649c115ee" containerID="5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f" exitCode=0 Jun 10 20:54:41.088912 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.088873 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" Jun 10 20:54:41.089358 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.088904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" event={"ID":"d442a2d2-75cf-4313-8dff-e07649c115ee","Type":"ContainerDied","Data":"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f"} Jun 10 20:54:41.089358 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.088945 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9tvkm" event={"ID":"d442a2d2-75cf-4313-8dff-e07649c115ee","Type":"ContainerDied","Data":"ad0fcddd2d947a383c568638a779c6dd0e8de0c2c402fc674442ceb62a23aa5d"} Jun 10 20:54:41.089358 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.088963 2582 scope.go:117] "RemoveContainer" containerID="5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f" Jun 10 20:54:41.099053 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.099034 2582 scope.go:117] "RemoveContainer" containerID="5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f" Jun 10 20:54:41.099324 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:54:41.099304 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f\": container with ID starting with 5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f not found: ID does not exist" containerID="5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f" Jun 10 20:54:41.099383 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.099334 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f"} err="failed to get container status \"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f\": rpc error: code = NotFound desc = could not find container \"5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f\": container with ID starting with 5d25964ec820265c2433a4b07626bfb46be54d4c0c6e56f7987b2d5d1cb0f93f not found: ID does not exist" Jun 10 20:54:41.109371 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.109344 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:41.113121 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:41.113100 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9tvkm"] Jun 10 20:54:42.019807 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:42.019776 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6" path="/var/lib/kubelet/pods/8b4c5a9f-9c16-461b-8d3b-4cf9f16000b6/volumes" Jun 10 20:54:42.020029 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:54:42.020017 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d442a2d2-75cf-4313-8dff-e07649c115ee" path="/var/lib/kubelet/pods/d442a2d2-75cf-4313-8dff-e07649c115ee/volumes" Jun 10 20:55:18.500854 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:55:18.500817 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:57:06.034735 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:57:06.034643 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:57:06.038054 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:57:06.038029 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 20:58:10.778380 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.778339 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 20:58:10.778855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.778649 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d442a2d2-75cf-4313-8dff-e07649c115ee" containerName="authorino" Jun 10 20:58:10.778855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.778660 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d442a2d2-75cf-4313-8dff-e07649c115ee" containerName="authorino" Jun 10 20:58:10.778855 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.778750 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d442a2d2-75cf-4313-8dff-e07649c115ee" containerName="authorino" Jun 10 20:58:10.781728 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.781675 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.785662 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.785645 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 20:58:10.790960 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.790933 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 20:58:10.897220 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.897183 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.897423 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.897238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q77zh\" (UniqueName: \"kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.897423 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.897268 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.998611 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.998574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.998784 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.998621 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77zh\" (UniqueName: \"kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.998784 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.998642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:10.999379 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:10.999349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:11.001235 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:11.001210 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:11.009255 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:11.009229 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q77zh\" (UniqueName: \"kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh\") pod \"authorino-5f577b5bbd-88nfb\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:11.091464 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:11.091382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 20:58:11.230158 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:11.230128 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 20:58:11.232498 ip-10-0-139-104 kubenswrapper[2582]: W0610 20:58:11.232471 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefe44f28_01e5_422a_ab1a_be62b47a200c.slice/crio-4bbbfd30b65094e315b7742a8940bab14ab3f9e0718e86f8c84d00c7ba9b283b WatchSource:0}: Error finding container 4bbbfd30b65094e315b7742a8940bab14ab3f9e0718e86f8c84d00c7ba9b283b: Status 404 returned error can't find the container with id 4bbbfd30b65094e315b7742a8940bab14ab3f9e0718e86f8c84d00c7ba9b283b Jun 10 20:58:12.115251 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.115214 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" event={"ID":"efe44f28-01e5-422a-ab1a-be62b47a200c","Type":"ContainerStarted","Data":"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1"} Jun 10 20:58:12.115251 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.115254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" event={"ID":"efe44f28-01e5-422a-ab1a-be62b47a200c","Type":"ContainerStarted","Data":"4bbbfd30b65094e315b7742a8940bab14ab3f9e0718e86f8c84d00c7ba9b283b"} Jun 10 20:58:12.131513 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.131457 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" podStartSLOduration=1.743316844 podStartE2EDuration="2.131440495s" totalImagesPullingTime="388.123651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:58:12.131037319 +0000 UTC m=+966.600236178" watchObservedRunningTime="2026-06-10 20:58:12.131440495 +0000 UTC m=+966.600639353" Jun 10 20:58:12.160489 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.160451 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:58:12.160734 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.160698 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-86d98c589d-cgqhn" podUID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" containerName="authorino" containerID="cri-o://385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060" gracePeriod=30 Jun 10 20:58:12.412431 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.412399 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:58:12.512427 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.512396 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert\") pod \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " Jun 10 20:58:12.512595 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.512435 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb4t5\" (UniqueName: \"kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5\") pod \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\" (UID: \"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc\") " Jun 10 20:58:12.514737 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.514708 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5" (OuterVolumeSpecName: "kube-api-access-xb4t5") pod "6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" (UID: "6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc"). InnerVolumeSpecName "kube-api-access-xb4t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:58:12.522926 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.522902 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" (UID: "6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:58:12.613893 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.613863 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-tls-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:58:12.613893 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:12.613887 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb4t5\" (UniqueName: \"kubernetes.io/projected/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc-kube-api-access-xb4t5\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 20:58:13.121159 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.121122 2582 generic.go:356] "Generic (PLEG): container finished" podID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" containerID="385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060" exitCode=0 Jun 10 20:58:13.121605 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.121166 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d98c589d-cgqhn" Jun 10 20:58:13.121605 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.121207 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d98c589d-cgqhn" event={"ID":"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc","Type":"ContainerDied","Data":"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060"} Jun 10 20:58:13.121605 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.121252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d98c589d-cgqhn" event={"ID":"6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc","Type":"ContainerDied","Data":"45e92fadf2c8a1c6cc9ae03b561f8faef92cd71f42c8a78a6cf8c5f31f1abb07"} Jun 10 20:58:13.121605 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.121276 2582 scope.go:117] "RemoveContainer" containerID="385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060" Jun 10 20:58:13.130266 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.130251 2582 scope.go:117] "RemoveContainer" containerID="385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060" Jun 10 20:58:13.130550 ip-10-0-139-104 kubenswrapper[2582]: E0610 20:58:13.130531 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060\": container with ID starting with 385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060 not found: ID does not exist" containerID="385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060" Jun 10 20:58:13.130590 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.130558 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060"} err="failed to get container status \"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060\": rpc error: code = NotFound desc = could not find container \"385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060\": container with ID starting with 385e489514e7a52e52eba8c7f47e004c1523c767d59bcce5c201084313314060 not found: ID does not exist" Jun 10 20:58:13.142940 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.142914 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:58:13.146924 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:13.146899 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86d98c589d-cgqhn"] Jun 10 20:58:14.019412 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:14.019375 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" path="/var/lib/kubelet/pods/6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc/volumes" Jun 10 20:58:40.215668 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:58:40.215561 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:59:12.792092 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:59:12.792046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:59:21.496059 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:59:21.496010 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:59:29.893889 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:59:29.893856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 20:59:57.601210 ip-10-0-139-104 kubenswrapper[2582]: I0610 20:59:57.601119 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:00:00.143650 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.143609 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29685420-ks6hq"] Jun 10 21:00:00.144040 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.143964 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" containerName="authorino" Jun 10 21:00:00.144040 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.143977 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" containerName="authorino" Jun 10 21:00:00.144114 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.144050 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb2e1e2-dfe4-4c5b-ac83-1acde92fe9dc" containerName="authorino" Jun 10 21:00:00.146927 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.146910 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:00.149937 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.149913 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdrst\"" Jun 10 21:00:00.157932 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.157905 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685420-ks6hq"] Jun 10 21:00:00.227412 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.227377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqr8k\" (UniqueName: \"kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k\") pod \"maas-api-key-cleanup-29685420-ks6hq\" (UID: \"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd\") " pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:00.328361 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.328319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqr8k\" (UniqueName: \"kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k\") pod \"maas-api-key-cleanup-29685420-ks6hq\" (UID: \"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd\") " pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:00.337532 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.337509 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqr8k\" (UniqueName: \"kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k\") pod \"maas-api-key-cleanup-29685420-ks6hq\" (UID: \"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd\") " pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:00.458106 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.458072 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:00.591890 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.591863 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685420-ks6hq"] Jun 10 21:00:00.594045 ip-10-0-139-104 kubenswrapper[2582]: W0610 21:00:00.594019 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28037f7f_36d3_4c4d_b7a7_fc0b5b24fafd.slice/crio-47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585 WatchSource:0}: Error finding container 47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585: Status 404 returned error can't find the container with id 47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585 Jun 10 21:00:00.595906 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.595889 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 21:00:00.641803 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:00.641760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" event={"ID":"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd","Type":"ContainerStarted","Data":"47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585"} Jun 10 21:00:02.396591 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:02.396547 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:00:04.664742 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:04.664631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" event={"ID":"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd","Type":"ContainerStarted","Data":"40846d4db966b698d38ded26d886ae88499e25704947640627ec909723bbd3d2"} Jun 10 21:00:04.682849 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:04.682796 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" podStartSLOduration=1.2796503320000001 podStartE2EDuration="4.682779626s" totalImagesPullingTime="3.403129294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:00:04.681384651 +0000 UTC m=+1079.150583521" watchObservedRunningTime="2026-06-10 21:00:04.682779626 +0000 UTC m=+1079.151978485" Jun 10 21:00:05.671638 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:05.671599 2582 generic.go:356] "Generic (PLEG): container finished" podID="28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd" containerID="40846d4db966b698d38ded26d886ae88499e25704947640627ec909723bbd3d2" exitCode=0 Jun 10 21:00:05.671638 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:05.671641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" event={"ID":"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd","Type":"ContainerDied","Data":"40846d4db966b698d38ded26d886ae88499e25704947640627ec909723bbd3d2"} Jun 10 21:00:06.809409 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:06.809383 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:06.885327 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:06.885290 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqr8k\" (UniqueName: \"kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k\") pod \"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd\" (UID: \"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd\") " Jun 10 21:00:06.887613 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:06.887587 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k" (OuterVolumeSpecName: "kube-api-access-cqr8k") pod "28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd" (UID: "28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd"). InnerVolumeSpecName "kube-api-access-cqr8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:00:06.986396 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:06.986348 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqr8k\" (UniqueName: \"kubernetes.io/projected/28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd-kube-api-access-cqr8k\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 21:00:07.682399 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:07.682365 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" Jun 10 21:00:07.682576 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:07.682368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685420-ks6hq" event={"ID":"28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd","Type":"ContainerDied","Data":"47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585"} Jun 10 21:00:07.682576 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:00:07.682490 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47fa091d84de039e19b5b04a568bf0b2f8f2d5e893e8033b1dd4e4f3c9682585" Jun 10 21:01:10.564843 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.564809 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-859d75df69-8fzmg"] Jun 10 21:01:10.565418 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.565208 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd" containerName="cleanup" Jun 10 21:01:10.565418 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.565222 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd" containerName="cleanup" Jun 10 21:01:10.565418 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.565284 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd" containerName="cleanup" Jun 10 21:01:10.567899 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.567883 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.576575 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.576554 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-859d75df69-8fzmg"] Jun 10 21:01:10.647494 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.647446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7dq\" (UniqueName: \"kubernetes.io/projected/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-kube-api-access-2x7dq\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.647494 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.647495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-tls-cert\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.647728 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.647552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-oidc-ca\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.748213 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.748177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-oidc-ca\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.748375 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.748269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7dq\" (UniqueName: \"kubernetes.io/projected/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-kube-api-access-2x7dq\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.748375 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.748292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-tls-cert\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.748849 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.748823 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-oidc-ca\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.750831 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.750812 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-tls-cert\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.756266 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.756239 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7dq\" (UniqueName: \"kubernetes.io/projected/0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7-kube-api-access-2x7dq\") pod \"authorino-859d75df69-8fzmg\" (UID: \"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7\") " pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:10.877450 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:10.877365 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-859d75df69-8fzmg" Jun 10 21:01:11.013658 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:11.013633 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-859d75df69-8fzmg"] Jun 10 21:01:11.016018 ip-10-0-139-104 kubenswrapper[2582]: W0610 21:01:11.015975 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a3dc8d8_f7e9_45db_ba0b_0951d5dd21c7.slice/crio-03b995d8e5009169165bdec0b69b58ec38e1fa40910e89853167b5ac5c9a8121 WatchSource:0}: Error finding container 03b995d8e5009169165bdec0b69b58ec38e1fa40910e89853167b5ac5c9a8121: Status 404 returned error can't find the container with id 03b995d8e5009169165bdec0b69b58ec38e1fa40910e89853167b5ac5c9a8121 Jun 10 21:01:11.997853 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:11.997807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859d75df69-8fzmg" event={"ID":"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7","Type":"ContainerStarted","Data":"66cdf28cffa8739ec7dbac98af1dee2ef0620aa5f55430bb7358963e142b8d4e"} Jun 10 21:01:11.998380 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:11.997862 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-859d75df69-8fzmg" event={"ID":"0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7","Type":"ContainerStarted","Data":"03b995d8e5009169165bdec0b69b58ec38e1fa40910e89853167b5ac5c9a8121"} Jun 10 21:01:12.019342 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.018877 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-859d75df69-8fzmg" podStartSLOduration=1.6197452860000001 podStartE2EDuration="2.018852612s" totalImagesPullingTime="399.107326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:01:12.016785579 +0000 UTC m=+1146.485984453" watchObservedRunningTime="2026-06-10 21:01:12.018852612 +0000 UTC m=+1146.488051471" Jun 10 21:01:12.049461 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.049422 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 21:01:12.049714 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.049659 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" podUID="efe44f28-01e5-422a-ab1a-be62b47a200c" containerName="authorino" containerID="cri-o://b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1" gracePeriod=30 Jun 10 21:01:12.319822 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.319798 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 21:01:12.362928 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.362895 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q77zh\" (UniqueName: \"kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh\") pod \"efe44f28-01e5-422a-ab1a-be62b47a200c\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " Jun 10 21:01:12.363104 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.362973 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert\") pod \"efe44f28-01e5-422a-ab1a-be62b47a200c\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " Jun 10 21:01:12.363104 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.363011 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca\") pod \"efe44f28-01e5-422a-ab1a-be62b47a200c\" (UID: \"efe44f28-01e5-422a-ab1a-be62b47a200c\") " Jun 10 21:01:12.365298 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.365263 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh" (OuterVolumeSpecName: "kube-api-access-q77zh") pod "efe44f28-01e5-422a-ab1a-be62b47a200c" (UID: "efe44f28-01e5-422a-ab1a-be62b47a200c"). InnerVolumeSpecName "kube-api-access-q77zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:01:12.369192 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.369130 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "efe44f28-01e5-422a-ab1a-be62b47a200c" (UID: "efe44f28-01e5-422a-ab1a-be62b47a200c"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 21:01:12.378838 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.378777 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "efe44f28-01e5-422a-ab1a-be62b47a200c" (UID: "efe44f28-01e5-422a-ab1a-be62b47a200c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 21:01:12.463547 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.463508 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efe44f28-01e5-422a-ab1a-be62b47a200c-tls-cert\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 21:01:12.463547 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.463541 2582 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efe44f28-01e5-422a-ab1a-be62b47a200c-oidc-ca\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 21:01:12.463547 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:12.463552 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q77zh\" (UniqueName: \"kubernetes.io/projected/efe44f28-01e5-422a-ab1a-be62b47a200c-kube-api-access-q77zh\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 21:01:13.003970 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.003934 2582 generic.go:356] "Generic (PLEG): container finished" podID="efe44f28-01e5-422a-ab1a-be62b47a200c" containerID="b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1" exitCode=0 Jun 10 21:01:13.004442 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.003978 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" Jun 10 21:01:13.004442 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.004039 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" event={"ID":"efe44f28-01e5-422a-ab1a-be62b47a200c","Type":"ContainerDied","Data":"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1"} Jun 10 21:01:13.004442 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.004087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f577b5bbd-88nfb" event={"ID":"efe44f28-01e5-422a-ab1a-be62b47a200c","Type":"ContainerDied","Data":"4bbbfd30b65094e315b7742a8940bab14ab3f9e0718e86f8c84d00c7ba9b283b"} Jun 10 21:01:13.004442 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.004110 2582 scope.go:117] "RemoveContainer" containerID="b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1" Jun 10 21:01:13.013815 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.013635 2582 scope.go:117] "RemoveContainer" containerID="b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1" Jun 10 21:01:13.013972 ip-10-0-139-104 kubenswrapper[2582]: E0610 21:01:13.013950 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1\": container with ID starting with b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1 not found: ID does not exist" containerID="b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1" Jun 10 21:01:13.014031 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.013983 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1"} err="failed to get container status \"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1\": rpc error: code = NotFound desc = could not find container \"b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1\": container with ID starting with b40fd60cb23f9e172fdaff37e567f2a45ef58d332bb8827513ea35afa3d8d5b1 not found: ID does not exist" Jun 10 21:01:13.025711 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.025689 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 21:01:13.029853 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:13.029833 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f577b5bbd-88nfb"] Jun 10 21:01:14.018652 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:14.018617 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe44f28-01e5-422a-ab1a-be62b47a200c" path="/var/lib/kubelet/pods/efe44f28-01e5-422a-ab1a-be62b47a200c/volumes" Jun 10 21:01:41.795250 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:41.795162 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:01:52.408800 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:01:52.408765 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:02:01.006251 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:01.006206 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:02:06.074098 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:06.074057 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:02:06.080205 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:06.080176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:02:10.997407 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:10.997375 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:02:20.489765 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:20.489723 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:02:30.694974 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:02:30.694933 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:03:45.795060 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:03:45.795020 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:04:01.008813 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:04:01.008775 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:04:40.207024 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:04:40.206939 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:04:56.687469 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:04:56.687433 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:05:11.097775 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:05:11.097731 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:05:26.490094 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:05:26.490055 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:05:30.394722 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:05:30.394668 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:06:03.108203 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:06:03.108168 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:06:07.598393 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:06:07.598353 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:06:28.689167 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:06:28.689128 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:06:37.594385 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:06:37.594350 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:06:54.288164 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:06:54.288124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:07:02.707371 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:07:02.707329 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:07:06.104890 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:07:06.104860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:07:06.112341 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:07:06.112316 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:07:20.296570 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:07:20.296527 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:07:28.588739 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:07:28.588653 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:01.008602 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:01.008559 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:09.207086 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:09.207045 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:12.597149 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:12.597107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:18.992178 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:18.992142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:26.200655 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:26.200613 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:08:34.601968 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:08:34.601933 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:09:00.402264 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:09:00.402184 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:09:14.306341 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:09:14.306298 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:02.800493 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:02.800453 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:10.592823 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:10.592785 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:29.398730 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:29.398612 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:38.201840 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:38.201799 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:47.101533 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:47.101495 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:10:55.493091 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:10:55.493047 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:04.105728 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:04.105670 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:13.498845 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:13.498813 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:22.195845 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:22.195799 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:30.998143 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:30.998109 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:38.999340 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:38.999299 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:11:47.290769 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:11:47.290732 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:12:06.137437 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:12:06.137407 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:12:06.145463 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:12:06.145441 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:14:14.401811 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:14:14.401775 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:14:19.197960 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:14:19.197921 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:14:46.405616 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:14:46.405579 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:14:50.002721 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:14:50.002670 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:00.144095 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.144056 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29685435-rrrnl"] Jun 10 21:15:00.144471 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.144379 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe44f28-01e5-422a-ab1a-be62b47a200c" containerName="authorino" Jun 10 21:15:00.144471 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.144390 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe44f28-01e5-422a-ab1a-be62b47a200c" containerName="authorino" Jun 10 21:15:00.144471 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.144454 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe44f28-01e5-422a-ab1a-be62b47a200c" containerName="authorino" Jun 10 21:15:00.147104 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.147087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:00.157766 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.157740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdrst\"" Jun 10 21:15:00.158987 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.158960 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685435-rrrnl"] Jun 10 21:15:00.256546 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.256500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6d5\" (UniqueName: \"kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5\") pod \"maas-api-key-cleanup-29685435-rrrnl\" (UID: \"f2a67224-9357-4469-ab9d-2f9a11de99a2\") " pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:00.357647 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.357592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6d5\" (UniqueName: \"kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5\") pod \"maas-api-key-cleanup-29685435-rrrnl\" (UID: \"f2a67224-9357-4469-ab9d-2f9a11de99a2\") " pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:00.367526 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.367499 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6d5\" (UniqueName: \"kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5\") pod \"maas-api-key-cleanup-29685435-rrrnl\" (UID: \"f2a67224-9357-4469-ab9d-2f9a11de99a2\") " pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:00.457820 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.457777 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:00.612968 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.612787 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685435-rrrnl"] Jun 10 21:15:00.615422 ip-10-0-139-104 kubenswrapper[2582]: W0610 21:15:00.615394 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a67224_9357_4469_ab9d_2f9a11de99a2.slice/crio-9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11 WatchSource:0}: Error finding container 9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11: Status 404 returned error can't find the container with id 9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11 Jun 10 21:15:00.905610 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:00.905574 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:01.048341 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:01.048256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" event={"ID":"f2a67224-9357-4469-ab9d-2f9a11de99a2","Type":"ContainerStarted","Data":"08b868c99cec9e5b799e28bfa6f7d215d3696c2b81f3e8be93a242c9f3cf926d"} Jun 10 21:15:01.048341 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:01.048310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" event={"ID":"f2a67224-9357-4469-ab9d-2f9a11de99a2","Type":"ContainerStarted","Data":"9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11"} Jun 10 21:15:01.070545 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:01.070496 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" podStartSLOduration=1.070476693 podStartE2EDuration="1.070476693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:15:01.069244878 +0000 UTC m=+1975.538443738" watchObservedRunningTime="2026-06-10 21:15:01.070476693 +0000 UTC m=+1975.539675551" Jun 10 21:15:02.054811 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:02.054772 2582 generic.go:356] "Generic (PLEG): container finished" podID="f2a67224-9357-4469-ab9d-2f9a11de99a2" containerID="08b868c99cec9e5b799e28bfa6f7d215d3696c2b81f3e8be93a242c9f3cf926d" exitCode=0 Jun 10 21:15:02.055245 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:02.054853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" event={"ID":"f2a67224-9357-4469-ab9d-2f9a11de99a2","Type":"ContainerDied","Data":"08b868c99cec9e5b799e28bfa6f7d215d3696c2b81f3e8be93a242c9f3cf926d"} Jun 10 21:15:03.203887 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:03.203858 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:03.284812 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:03.284773 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x6d5\" (UniqueName: \"kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5\") pod \"f2a67224-9357-4469-ab9d-2f9a11de99a2\" (UID: \"f2a67224-9357-4469-ab9d-2f9a11de99a2\") " Jun 10 21:15:03.287038 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:03.287011 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5" (OuterVolumeSpecName: "kube-api-access-2x6d5") pod "f2a67224-9357-4469-ab9d-2f9a11de99a2" (UID: "f2a67224-9357-4469-ab9d-2f9a11de99a2"). InnerVolumeSpecName "kube-api-access-2x6d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:15:03.385777 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:03.385661 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6d5\" (UniqueName: \"kubernetes.io/projected/f2a67224-9357-4469-ab9d-2f9a11de99a2-kube-api-access-2x6d5\") on node \"ip-10-0-139-104.ec2.internal\" DevicePath \"\"" Jun 10 21:15:04.072857 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:04.072830 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" Jun 10 21:15:04.073023 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:04.072861 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685435-rrrnl" event={"ID":"f2a67224-9357-4469-ab9d-2f9a11de99a2","Type":"ContainerDied","Data":"9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11"} Jun 10 21:15:04.073023 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:04.072910 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d1cec8c438a2065378da4e03057baf192bdeb822e5869415916131e7a3c7d11" Jun 10 21:15:10.298542 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:10.298502 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:20.210797 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:20.210753 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:30.204311 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:30.204264 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:38.901423 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:38.901387 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:48.499436 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:48.499398 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:15:58.098533 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:15:58.098499 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:16:08.803558 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:16:08.803517 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:16:17.605960 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:16:17.605922 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:16:22.705794 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:16:22.705755 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:16:50.899370 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:16:50.899277 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:17:06.175148 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:06.175118 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:17:06.182948 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:06.182927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:17:34.718112 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:34.718072 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:17:41.892268 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:41.892230 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:17:50.911096 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:50.911056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:17:59.692748 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:17:59.692643 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:08.097860 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:08.097821 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:20.700167 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:20.700131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:30.689582 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:30.689550 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:35.105640 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:35.105599 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:44.095266 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:44.095233 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:18:52.790245 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:18:52.790206 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:00.589560 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:00.589523 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:10.995372 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:10.995325 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:30.085413 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:30.085318 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:37.488020 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:37.487982 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:47.691376 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:47.691339 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:19:54.695117 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:19:54.695078 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:13.140652 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:13.140610 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:20.207659 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:20.207620 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:30.096777 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:30.096739 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:37.684174 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:37.684134 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:47.292945 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:47.292906 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:20:55.087391 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:20:55.087306 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:04.889920 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:04.889888 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:16.791245 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:16.791205 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:25.991156 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:25.991118 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:36.990820 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:36.990786 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:47.796599 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:47.796562 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:21:51.989222 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:21:51.989185 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:01.795755 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:01.795715 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:06.093159 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:06.093122 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:06.205961 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:06.205932 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:22:06.214709 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:06.214674 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:22:22.793855 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:22.793815 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:31.388963 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:31.388870 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:40.694712 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:40.694660 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:22:46.594905 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:22:46.594865 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:23:08.395546 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:23:08.395507 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:23:20.886235 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:23:20.886195 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dbrjb"] Jun 10 21:23:54.110015 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:23:54.109927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-859d75df69-8fzmg_0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7/authorino/0.log" Jun 10 21:23:59.196164 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:23:59.196130 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685420-ks6hq_28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd/cleanup/0.log" Jun 10 21:23:59.305466 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:23:59.305434 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685435-rrrnl_f2a67224-9357-4469-ab9d-2f9a11de99a2/cleanup/0.log" Jun 10 21:24:00.005302 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:00.005271 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-gs9cg_3589057e-0fe9-4466-abc5-0f3ea3041622/copy-manifests/0.log" Jun 10 21:24:00.012044 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:00.012021 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-gs9cg_3589057e-0fe9-4466-abc5-0f3ea3041622/manager/0.log" Jun 10 21:24:00.865542 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:00.865509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/util/0.log" Jun 10 21:24:00.871841 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:00.871821 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/pull/0.log" Jun 10 21:24:00.878267 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:00.878247 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/extract/0.log" Jun 10 21:24:01.115168 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.115142 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/util/0.log" Jun 10 21:24:01.121007 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.120941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/pull/0.log" Jun 10 21:24:01.126452 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.126432 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/extract/0.log" Jun 10 21:24:01.236855 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.236826 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/util/0.log" Jun 10 21:24:01.243193 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.243164 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/pull/0.log" Jun 10 21:24:01.249175 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.249151 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/extract/0.log" Jun 10 21:24:01.362615 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.362585 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-859d75df69-8fzmg_0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7/authorino/0.log" Jun 10 21:24:01.482867 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:01.482843 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-whdqv_1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9/manager/0.log" Jun 10 21:24:02.076528 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:02.076497 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dbrjb_569c3915-2a52-4d03-aba3-6fe9a96424da/limitador/0.log" Jun 10 21:24:02.872189 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:02.872160 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-qdcvp_26b5b7c2-967c-49e2-9eee-be83ba3a216f/kube-auth-proxy/0.log" Jun 10 21:24:03.333039 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:03.333006 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-657b964c49-c9kq9_fca55e88-563f-4ff3-9e42-9548b2550a81/router/0.log" Jun 10 21:24:08.730195 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.730155 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9b7t2/must-gather-xb2bq"] Jun 10 21:24:08.730698 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.730641 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a67224-9357-4469-ab9d-2f9a11de99a2" containerName="cleanup" Jun 10 21:24:08.730698 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.730663 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a67224-9357-4469-ab9d-2f9a11de99a2" containerName="cleanup" Jun 10 21:24:08.730887 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.730822 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2a67224-9357-4469-ab9d-2f9a11de99a2" containerName="cleanup" Jun 10 21:24:08.734094 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.734077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:08.736762 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.736740 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"kube-root-ca.crt\"" Jun 10 21:24:08.737911 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.737861 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9b7t2\"/\"default-dockercfg-8z9p5\"" Jun 10 21:24:08.737911 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.737888 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"openshift-service-ca.crt\"" Jun 10 21:24:08.741921 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.741637 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/must-gather-xb2bq"] Jun 10 21:24:08.915088 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.915050 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt969\" (UniqueName: \"kubernetes.io/projected/66f6129e-d7fe-4754-8942-952a584a60cd-kube-api-access-gt969\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:08.915298 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:08.915199 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/66f6129e-d7fe-4754-8942-952a584a60cd-must-gather-output\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.016639 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.016546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/66f6129e-d7fe-4754-8942-952a584a60cd-must-gather-output\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.016639 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.016590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt969\" (UniqueName: \"kubernetes.io/projected/66f6129e-d7fe-4754-8942-952a584a60cd-kube-api-access-gt969\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.016981 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.016960 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/66f6129e-d7fe-4754-8942-952a584a60cd-must-gather-output\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.025423 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.025391 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt969\" (UniqueName: \"kubernetes.io/projected/66f6129e-d7fe-4754-8942-952a584a60cd-kube-api-access-gt969\") pod \"must-gather-xb2bq\" (UID: \"66f6129e-d7fe-4754-8942-952a584a60cd\") " pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.045392 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.045355 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" Jun 10 21:24:09.183112 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.183087 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/must-gather-xb2bq"] Jun 10 21:24:09.185407 ip-10-0-139-104 kubenswrapper[2582]: W0610 21:24:09.185379 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66f6129e_d7fe_4754_8942_952a584a60cd.slice/crio-9efcdade92d19a2107a8f02b03fa6fb72e31e022fbdbb4a8bc3ac68f288fe265 WatchSource:0}: Error finding container 9efcdade92d19a2107a8f02b03fa6fb72e31e022fbdbb4a8bc3ac68f288fe265: Status 404 returned error can't find the container with id 9efcdade92d19a2107a8f02b03fa6fb72e31e022fbdbb4a8bc3ac68f288fe265 Jun 10 21:24:09.187423 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.187404 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 21:24:09.753393 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:09.753353 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" event={"ID":"66f6129e-d7fe-4754-8942-952a584a60cd","Type":"ContainerStarted","Data":"9efcdade92d19a2107a8f02b03fa6fb72e31e022fbdbb4a8bc3ac68f288fe265"} Jun 10 21:24:10.763063 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:10.763025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" event={"ID":"66f6129e-d7fe-4754-8942-952a584a60cd","Type":"ContainerStarted","Data":"0b923c23b26df2dc3f2d9e87d13d24f2892c36a5e7608514ca42607558d92284"} Jun 10 21:24:10.763537 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:10.763077 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" event={"ID":"66f6129e-d7fe-4754-8942-952a584a60cd","Type":"ContainerStarted","Data":"1a40e0126007085a52ca34fb368fcdc48e006e17d1279be23cd4a3ebd6018199"} Jun 10 21:24:10.781658 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:10.781586 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9b7t2/must-gather-xb2bq" podStartSLOduration=1.7872635909999999 podStartE2EDuration="2.78156218s" totalImagesPullingTime="994.298589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:24:10.779466056 +0000 UTC m=+2525.248664914" watchObservedRunningTime="2026-06-10 21:24:10.78156218 +0000 UTC m=+2525.250761041" Jun 10 21:24:11.944197 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:11.944163 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bbbn9_27760ec5-855d-45f5-ac68-2397663005d0/global-pull-secret-syncer/0.log" Jun 10 21:24:12.065348 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:12.065319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jfb56_5cd3b208-0dfd-4c3a-8736-298a7c4b98d9/konnectivity-agent/0.log" Jun 10 21:24:12.112353 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:12.112310 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-104.ec2.internal_b4735bec38b2ae745cdf385bb1d88877/haproxy/0.log" Jun 10 21:24:16.642527 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.642313 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/extract/0.log" Jun 10 21:24:16.667741 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.667709 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/util/0.log" Jun 10 21:24:16.701041 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.700989 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tfkp2_8fda72bc-24f7-45b2-9149-bb6a656fb074/pull/0.log" Jun 10 21:24:16.827186 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.827150 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/extract/0.log" Jun 10 21:24:16.849025 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.848999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/util/0.log" Jun 10 21:24:16.870915 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.870882 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73whmmp_a5fe641b-4649-45a3-b7fb-efdfdd17596b/pull/0.log" Jun 10 21:24:16.904585 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.904505 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/extract/0.log" Jun 10 21:24:16.926354 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.926326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/util/0.log" Jun 10 21:24:16.948954 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:16.948929 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sbmbh_d589a8d8-54b3-44a5-98a7-5ef1cb590e4c/pull/0.log" Jun 10 21:24:17.277698 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:17.277644 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-859d75df69-8fzmg_0a3dc8d8-f7e9-45db-ba0b-0951d5dd21c7/authorino/0.log" Jun 10 21:24:17.305613 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:17.305577 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-whdqv_1f1c4de4-b4b7-4f19-9379-d4c5fbe3f7c9/manager/0.log" Jun 10 21:24:17.519545 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:17.519485 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dbrjb_569c3915-2a52-4d03-aba3-6fe9a96424da/limitador/0.log" Jun 10 21:24:19.556184 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:19.556137 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57c496979-7zthv_fa348a99-99b4-474b-9e4b-6c71e15e96ff/metrics-server/0.log" Jun 10 21:24:19.581849 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:19.581820 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-mqnvj_b03b4908-1751-496d-9d51-36289a439d12/monitoring-plugin/0.log" Jun 10 21:24:19.789622 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:19.789588 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx9p9_22e49fe6-b34c-41dd-80dd-dc5b7eece2fd/node-exporter/0.log" Jun 10 21:24:19.814275 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:19.814153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx9p9_22e49fe6-b34c-41dd-80dd-dc5b7eece2fd/kube-rbac-proxy/0.log" Jun 10 21:24:19.842806 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:19.842775 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vx9p9_22e49fe6-b34c-41dd-80dd-dc5b7eece2fd/init-textfile/0.log" Jun 10 21:24:20.120464 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.120370 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xsn6n_9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5/prometheus-operator/0.log" Jun 10 21:24:20.142991 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.142965 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xsn6n_9f0f22e0-f1f8-4af8-ac36-ac95560d3cc5/kube-rbac-proxy/0.log" Jun 10 21:24:20.176884 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.176839 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-t6crx_20b3c7aa-5ac8-4078-a796-3417a175e333/prometheus-operator-admission-webhook/0.log" Jun 10 21:24:20.210325 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.210205 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb59f485f-pnzmw_a3b8e672-3f6b-4b45-a341-b412b2c9404d/telemeter-client/0.log" Jun 10 21:24:20.236648 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.236614 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb59f485f-pnzmw_a3b8e672-3f6b-4b45-a341-b412b2c9404d/reload/0.log" Jun 10 21:24:20.262512 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:20.262485 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb59f485f-pnzmw_a3b8e672-3f6b-4b45-a341-b412b2c9404d/kube-rbac-proxy/0.log" Jun 10 21:24:23.031298 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.031269 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f676c9cdc-fppk2_651158c7-8c1d-44c0-8e9d-5726292d8fa1/console/0.log" Jun 10 21:24:23.684241 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.684201 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9"] Jun 10 21:24:23.692063 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.692020 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.694269 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.694242 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9"] Jun 10 21:24:23.754417 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.754236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-lib-modules\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.754417 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.754343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgm8\" (UniqueName: \"kubernetes.io/projected/42343e0d-c9e8-4a56-8589-471ef058f03a-kube-api-access-bwgm8\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.754631 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.754514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-sys\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.754670 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.754638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-proc\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.754751 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.754726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-podres\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.804049 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.804022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-bnhpl_13b5f593-3f56-4c75-9087-8b5531764819/volume-data-source-validator/0.log" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-sys\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-proc\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-podres\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-lib-modules\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgm8\" (UniqueName: \"kubernetes.io/projected/42343e0d-c9e8-4a56-8589-471ef058f03a-kube-api-access-bwgm8\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-proc\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.856968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-sys\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.857027 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-podres\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.857097 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.857047 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42343e0d-c9e8-4a56-8589-471ef058f03a-lib-modules\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:23.865983 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:23.865948 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgm8\" (UniqueName: \"kubernetes.io/projected/42343e0d-c9e8-4a56-8589-471ef058f03a-kube-api-access-bwgm8\") pod \"perf-node-gather-daemonset-q7jf9\" (UID: \"42343e0d-c9e8-4a56-8589-471ef058f03a\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:24.009376 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.009331 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:24.210292 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.210240 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9"] Jun 10 21:24:24.868768 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.868723 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" event={"ID":"42343e0d-c9e8-4a56-8589-471ef058f03a","Type":"ContainerStarted","Data":"1322d56ef21fd5d7f8cc85371f35723a08e9de9e7bd8c26a7651422145635098"} Jun 10 21:24:24.868969 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.868826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" event={"ID":"42343e0d-c9e8-4a56-8589-471ef058f03a","Type":"ContainerStarted","Data":"2252ae77c7004ae4c6d257358de522be1989383eaa32222fe554961da344b518"} Jun 10 21:24:24.869644 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.869617 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:24.888069 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:24.888002 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" podStartSLOduration=1.88797447 podStartE2EDuration="1.88797447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 21:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:24:24.885069619 +0000 UTC m=+2539.354268505" watchObservedRunningTime="2026-06-10 21:24:24.88797447 +0000 UTC m=+2539.357173333" Jun 10 21:24:25.088075 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:25.088031 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjnql_025d69db-7f09-45ce-919a-39dc16f9150e/dns/0.log" Jun 10 21:24:25.110471 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:25.110442 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjnql_025d69db-7f09-45ce-919a-39dc16f9150e/kube-rbac-proxy/0.log" Jun 10 21:24:25.221691 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:25.221650 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4f4d_1a02cca1-add2-4bde-bded-7fb2b945fdfe/dns-node-resolver/0.log" Jun 10 21:24:25.801969 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:25.801939 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfl9p_572b6584-7821-4c1c-bd36-5f7afab6d20f/node-ca/0.log" Jun 10 21:24:26.871083 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:26.871054 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-qdcvp_26b5b7c2-967c-49e2-9eee-be83ba3a216f/kube-auth-proxy/0.log" Jun 10 21:24:27.028937 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:27.028909 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-657b964c49-c9kq9_fca55e88-563f-4ff3-9e42-9548b2550a81/router/0.log" Jun 10 21:24:27.675834 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:27.675807 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvgdp_11f54219-2b12-41d2-9e0f-a98355d347ac/serve-healthcheck-canary/0.log" Jun 10 21:24:28.324483 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:28.324454 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpnkg_650b0f52-3cd1-4c3f-b423-e9eb5235fa3d/kube-rbac-proxy/0.log" Jun 10 21:24:28.344507 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:28.344472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpnkg_650b0f52-3cd1-4c3f-b423-e9eb5235fa3d/exporter/0.log" Jun 10 21:24:28.364705 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:28.364664 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mpnkg_650b0f52-3cd1-4c3f-b423-e9eb5235fa3d/extractor/0.log" Jun 10 21:24:30.729295 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:30.729266 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685420-ks6hq_28037f7f-36d3-4c4d-b7a7-fc0b5b24fafd/cleanup/0.log" Jun 10 21:24:30.756370 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:30.756335 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685435-rrrnl_f2a67224-9357-4469-ab9d-2f9a11de99a2/cleanup/0.log" Jun 10 21:24:31.087641 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:31.087565 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-gs9cg_3589057e-0fe9-4466-abc5-0f3ea3041622/manager/0.log" Jun 10 21:24:31.108260 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:31.108226 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-gs9cg_3589057e-0fe9-4466-abc5-0f3ea3041622/copy-manifests/0.log" Jun 10 21:24:31.893534 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:31.893460 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-q7jf9" Jun 10 21:24:32.595873 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:32.595841 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-678cf7c548-lnnpd_81930013-c649-46dc-a980-a1dd5f6daea5/manager/0.log" Jun 10 21:24:37.428906 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:37.428831 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-qdcvp_26b5b7c2-967c-49e2-9eee-be83ba3a216f/kube-auth-proxy/0.log" Jun 10 21:24:37.567166 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:37.567136 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-657b964c49-c9kq9_fca55e88-563f-4ff3-9e42-9548b2550a81/router/0.log" Jun 10 21:24:38.719324 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:38.719294 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-qdcvp_26b5b7c2-967c-49e2-9eee-be83ba3a216f/kube-auth-proxy/0.log" Jun 10 21:24:38.858972 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:38.858944 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-657b964c49-c9kq9_fca55e88-563f-4ff3-9e42-9548b2550a81/router/0.log" Jun 10 21:24:40.100827 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.100799 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/kube-multus-additional-cni-plugins/0.log" Jun 10 21:24:40.122912 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.122883 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/egress-router-binary-copy/0.log" Jun 10 21:24:40.148147 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.148121 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/cni-plugins/0.log" Jun 10 21:24:40.173545 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.173516 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/bond-cni-plugin/0.log" Jun 10 21:24:40.195458 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.195435 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/routeoverride-cni/0.log" Jun 10 21:24:40.217144 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.217104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/whereabouts-cni-bincopy/0.log" Jun 10 21:24:40.237119 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.237079 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2d2x_831dd800-8b87-40ae-9529-a2a129d6696d/whereabouts-cni/0.log" Jun 10 21:24:40.571344 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.571316 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-qdcvp_26b5b7c2-967c-49e2-9eee-be83ba3a216f/kube-auth-proxy/0.log" Jun 10 21:24:40.634119 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.634083 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vwqk5_206e4f74-15a5-4585-a222-0f70726be05f/kube-multus/0.log" Jun 10 21:24:40.661287 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.661257 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27dpd_bfe6db47-fd6e-499d-afc1-0f1f215bcb64/network-metrics-daemon/0.log" Jun 10 21:24:40.682934 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.682906 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27dpd_bfe6db47-fd6e-499d-afc1-0f1f215bcb64/kube-rbac-proxy/0.log" Jun 10 21:24:40.713962 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:40.713936 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-657b964c49-c9kq9_fca55e88-563f-4ff3-9e42-9548b2550a81/router/0.log" Jun 10 21:24:41.870624 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.870593 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-controller/0.log" Jun 10 21:24:41.889555 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.889530 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/1.log" Jun 10 21:24:41.889751 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.889734 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovn-acl-logging/0.log" Jun 10 21:24:41.908522 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.908470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/kube-rbac-proxy-node/0.log" Jun 10 21:24:41.931783 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.931752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 21:24:41.947481 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.947456 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/northd/0.log" Jun 10 21:24:41.966792 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.966769 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/nbdb/0.log" Jun 10 21:24:41.986693 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:41.986646 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/sbdb/0.log" Jun 10 21:24:42.035391 ip-10-0-139-104 kubenswrapper[2582]: I0610 21:24:42.035296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94tqt_f08af48b-0f73-4004-8330-217412b098bd/ovnkube-controller/0.log"