Jun 11 12:18:15.462526 ip-10-0-141-209 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 12:18:15.462540 ip-10-0-141-209 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 12:18:15.462550 ip-10-0-141-209 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 12:18:15.462751 ip-10-0-141-209 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 12:18:26.704818 ip-10-0-141-209 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 12:18:26.704835 ip-10-0-141-209 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6ae181a0adad4f5185ec287a05c4f38e -- Jun 11 12:20:52.587490 ip-10-0-141-209 systemd[1]: Starting Kubernetes Kubelet... Jun 11 12:20:52.939750 ip-10-0-141-209 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:20:52.939750 ip-10-0-141-209 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 12:20:52.939750 ip-10-0-141-209 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:20:52.939750 ip-10-0-141-209 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 12:20:52.939750 ip-10-0-141-209 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:20:52.941911 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.941816 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 12:20:52.946662 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946644 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.946662 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946659 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946668 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946676 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946681 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946687 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946691 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946695 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946699 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946703 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946708 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946712 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946716 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946720 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946724 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946728 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946732 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946737 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946741 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946745 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.946809 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946749 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946754 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946758 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946762 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946766 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946771 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946775 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946779 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946784 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946788 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946792 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946796 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946800 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946804 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946808 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946814 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946819 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946823 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946827 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946831 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.947503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946836 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946840 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946844 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946852 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946859 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946863 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946868 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946872 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946876 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946880 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946885 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946889 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946893 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946897 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946903 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946908 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946912 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946917 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946920 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.948118 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946925 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946929 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946933 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946937 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946941 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946945 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946950 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946954 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946960 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946965 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946971 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946976 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946980 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946985 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946989 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946993 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.946998 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947005 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947009 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947013 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.948928 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947018 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947022 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947026 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947030 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947035 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947039 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947043 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947047 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947052 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947057 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947061 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947065 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947072 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947077 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947083 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947087 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947092 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947097 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947102 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.947106 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.949695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949383 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949399 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949406 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949411 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949415 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949419 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949423 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949427 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949432 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949436 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949446 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949454 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949458 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949461 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949464 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949466 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949469 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949472 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949476 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.950257 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949481 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949485 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949489 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949493 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949498 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949511 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949534 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949673 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949683 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949689 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949693 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949696 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949700 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949703 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949706 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949710 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949712 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949715 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949718 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.950760 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949720 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949723 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949726 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949729 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949731 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949734 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949736 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949739 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949742 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949744 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949747 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949749 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949752 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949754 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949756 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949759 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949762 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949765 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949768 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949771 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.951240 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949775 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949778 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949781 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949785 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949790 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949792 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949795 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949798 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949800 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949803 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949805 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949808 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949811 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949813 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949816 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949820 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949822 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949825 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949828 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949831 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.951803 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949833 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949836 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949838 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949841 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949844 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949847 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949850 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949854 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949858 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949861 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949865 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949868 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949871 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949873 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949876 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949879 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949882 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949885 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949887 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.952317 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949890 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.949893 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950300 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950305 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950309 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950312 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950315 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950317 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950320 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950324 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950328 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950332 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950334 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950337 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950340 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950343 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950346 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950349 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950357 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.952779 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950360 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950363 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950366 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950369 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950371 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950374 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950377 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950379 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950382 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950384 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950387 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950389 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950392 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950395 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950397 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950400 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950402 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950405 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950407 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950410 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.953263 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950412 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950415 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950418 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950421 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950424 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950427 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950431 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950434 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950437 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950439 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950442 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950445 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950449 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950452 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950455 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950458 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950460 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950463 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950465 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950468 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.953744 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950470 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950473 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950475 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950478 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950481 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950483 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950486 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950489 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950493 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950496 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950498 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950501 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950504 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950506 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950509 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950511 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950514 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950516 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950519 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.954266 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950523 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950525 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950527 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950530 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950532 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950535 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950538 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950545 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950548 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950550 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950553 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950556 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950558 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950561 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950563 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950566 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950569 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950571 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950574 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950576 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.954750 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950579 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950582 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.950584 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950654 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950661 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950668 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950673 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950679 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950684 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950690 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950697 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950700 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950703 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950707 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950710 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950713 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950717 2559 flags.go:64] FLAG: --cgroup-root="" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950720 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950723 2559 flags.go:64] FLAG: --client-ca-file="" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950728 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950732 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950736 2559 flags.go:64] FLAG: --cluster-domain="" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950739 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 12:20:52.955256 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950742 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950745 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950749 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950753 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950756 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950759 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950762 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950765 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950768 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950772 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950775 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950778 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950782 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950785 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950788 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950791 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950794 2559 flags.go:64] FLAG: --enable-server="true" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950797 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950801 2559 flags.go:64] FLAG: --event-burst="100" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950805 2559 flags.go:64] FLAG: --event-qps="50" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950807 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950810 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950813 2559 flags.go:64] FLAG: --eviction-hard="" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950817 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 12:20:52.955796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950820 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950823 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950828 2559 flags.go:64] FLAG: --eviction-soft="" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950831 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950835 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950839 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950842 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950845 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950848 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950851 2559 flags.go:64] FLAG: --feature-gates="" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950855 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950858 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950861 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950864 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950867 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950870 2559 flags.go:64] FLAG: --help="false" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950873 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-141-209.ec2.internal" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950876 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950879 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950882 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950885 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950888 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950891 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 12:20:52.956394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950894 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950897 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950900 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950903 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950906 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950909 2559 flags.go:64] FLAG: --kube-reserved="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950912 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950915 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950917 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950920 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950923 2559 flags.go:64] FLAG: --lock-file="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950927 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950930 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950934 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950940 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950943 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950946 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950949 2559 flags.go:64] FLAG: --logging-format="text" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950952 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950955 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950958 2559 flags.go:64] FLAG: --manifest-url="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950961 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950965 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950968 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950972 2559 flags.go:64] FLAG: --max-pods="110" Jun 11 12:20:52.956996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950975 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950979 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950981 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950984 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950987 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950990 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.950993 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951001 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951004 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951007 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951009 2559 flags.go:64] FLAG: --pod-cidr="" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951012 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951018 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951021 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951024 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951027 2559 flags.go:64] FLAG: --port="10250" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951030 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951033 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6d10f2a88e44a71" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951037 2559 flags.go:64] FLAG: --qos-reserved="" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951040 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951043 2559 flags.go:64] FLAG: --register-node="true" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951048 2559 flags.go:64] FLAG: --register-with-taints="" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951051 2559 flags.go:64] FLAG: --registry-burst="10" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951055 2559 flags.go:64] FLAG: --registry-qps="5" Jun 11 12:20:52.957655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951058 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951060 2559 flags.go:64] FLAG: --reserved-memory="" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951064 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951067 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951070 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951073 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951076 2559 flags.go:64] FLAG: --runonce="false" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951079 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951082 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951086 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951088 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951091 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951094 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951097 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951100 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951103 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951107 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951110 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951112 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951115 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951118 2559 flags.go:64] FLAG: --system-cgroups="" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951121 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951126 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951128 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951131 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 12:20:52.958255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951135 2559 flags.go:64] FLAG: --tls-min-version="" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951139 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951142 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951145 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951150 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951153 2559 flags.go:64] FLAG: --v="2" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951157 2559 flags.go:64] FLAG: --version="false" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951161 2559 flags.go:64] FLAG: --vmodule="" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951165 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951169 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951308 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951312 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951315 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951318 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951321 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951325 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951329 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951332 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951335 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951337 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951340 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951343 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.958851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951346 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951348 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951351 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951354 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951356 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951359 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951361 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951364 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951366 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951370 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951374 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951378 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951381 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951383 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951386 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951389 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951392 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951394 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951398 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.959401 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951401 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951403 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951406 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951409 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951411 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951413 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951416 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951418 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951421 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951423 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951426 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951428 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951431 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951433 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951436 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951440 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951443 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951446 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951449 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.959861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951452 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951454 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951456 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951459 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951461 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951466 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951469 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951471 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951474 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951476 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951479 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951482 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951484 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951487 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951490 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951492 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951495 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951497 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951500 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951502 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.960352 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951505 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951507 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951510 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951512 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951515 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951517 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951519 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951522 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951524 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951527 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951529 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951532 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951534 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951537 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951540 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951542 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951545 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951550 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951552 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951555 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.960821 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951558 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951560 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951563 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951565 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951568 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951570 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951573 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951576 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.951578 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.951587 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958069 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958084 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958104 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958110 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958161 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.961339 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958166 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958169 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958173 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958175 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958178 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958181 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958193 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958196 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958199 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958201 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958217 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958221 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958223 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958226 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958229 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958231 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958234 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958236 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958239 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958242 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.961715 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958244 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958247 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958249 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958252 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958255 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958257 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958260 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958263 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958267 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958270 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958273 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958276 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958278 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958281 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958283 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958286 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958290 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958293 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958296 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958299 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.962232 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958302 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958304 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958307 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958310 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958313 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958315 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958317 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958320 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958322 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958325 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958327 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958330 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958334 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958337 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958340 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958343 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958345 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958348 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958352 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.962709 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958354 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958357 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958361 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958364 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958366 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958369 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958372 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958375 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958377 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958380 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958382 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958385 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958387 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958390 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958392 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958395 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958397 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958400 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958402 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958405 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.963163 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958407 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958409 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958412 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958415 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958417 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958420 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958422 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958425 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958427 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958430 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958432 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958436 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958438 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958441 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958444 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958448 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958452 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958454 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.963695 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958457 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958462 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958586 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958591 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958594 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958596 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958599 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958602 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958604 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958607 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958610 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958612 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958615 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958617 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958620 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:20:52.964121 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958622 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958625 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958627 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958630 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958632 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958635 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958637 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958639 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958642 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958645 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958647 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958650 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958652 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958655 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958658 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958664 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958666 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958669 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958672 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958674 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:20:52.964503 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958676 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958679 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958681 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958684 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958686 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958689 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958691 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958693 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958696 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958698 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958701 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958704 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958706 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958709 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958711 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958713 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958716 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958718 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958721 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958723 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:20:52.964985 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958726 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958728 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958732 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958736 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958740 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958742 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958745 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958748 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958751 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958754 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958757 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958760 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958762 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958765 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958768 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958770 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958773 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958775 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958777 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:20:52.965562 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958780 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958782 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958785 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958787 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958790 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958792 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958795 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958798 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958801 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958804 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958806 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958809 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958811 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958814 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958817 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958819 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958823 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958827 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958829 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:20:52.966009 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958832 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958835 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958838 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958847 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958849 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958852 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958855 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:52.958858 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958863 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.958958 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.961033 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.962287 2559 server.go:1019] "Starting client certificate rotation" Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.962387 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:20:52.966501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.962416 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:20:52.966823 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.965244 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:20:52.966823 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.966375 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:20:52.976413 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.976395 2559 log.go:25] "Validated CRI v1 runtime API" Jun 11 12:20:52.979769 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.979283 2559 log.go:25] "Validated CRI v1 image API" Jun 11 12:20:52.980809 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.980791 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 12:20:52.986030 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.986011 2559 fs.go:135] Filesystem UUIDs: map[15ab8c23-b76f-4e87-9f76-2fae00214b2c:/dev/nvme0n1p4 56dce9f4-90b8-4507-8e45-3ceab5a1c76d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 12:20:52.986087 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.986030 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 12:20:52.989769 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.989748 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:20:52.991891 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.991788 2559 manager.go:216] Machine: {Timestamp:2026-06-11 12:20:52.990543174 +0000 UTC m=+0.288919667 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094546 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2624f7297f817185644afc7497bb SystemUUID:ec2f2624-f729-7f81-7185-644afc7497bb BootID:6ae181a0-adad-4f51-85ec-287a05c4f38e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:9d:18:4a:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:9d:18:4a:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:e2:c4:bc:98:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 12:20:52.991891 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.991889 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 12:20:52.991999 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.991960 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 12:20:52.995071 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.995049 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 12:20:52.995215 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.995073 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 12:20:52.995778 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.995768 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 12:20:52.995808 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.995781 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 12:20:52.995808 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.995788 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:20:52.996438 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.996428 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:20:52.997360 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:52.997349 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 12:20:53.000439 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000428 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:20:53.000709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000699 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 12:20:53.000739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000731 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 11 12:20:53.000765 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000740 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 12:20:53.000765 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000753 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 12:20:53.000765 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000762 2559 kubelet.go:398] "Adding apiserver pod source" Jun 11 12:20:53.000856 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.000773 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 12:20:53.001118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.001107 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:20:53.001159 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.001124 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:20:53.003887 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.003872 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 12:20:53.005718 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.005705 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 12:20:53.005762 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.005734 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 12:20:53.006823 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006811 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 12:20:53.006874 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006831 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 12:20:53.006874 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006841 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 12:20:53.006874 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006848 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 12:20:53.006874 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006862 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 12:20:53.006874 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006871 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006881 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006886 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006892 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006897 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006907 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 12:20:53.007011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.006913 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 12:20:53.008282 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.008268 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 12:20:53.008317 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.008284 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 12:20:53.011580 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.011566 2559 server.go:1268] "Started kubelet" Jun 11 12:20:53.011712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.011651 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 12:20:53.011769 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.011662 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 12:20:53.011820 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.011769 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 12:20:53.012507 ip-10-0-141-209 systemd[1]: Started Kubernetes Kubelet. Jun 11 12:20:53.013111 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.012797 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 12:20:53.013111 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.012818 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 12:20:53.013111 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.012838 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 12:20:53.013567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.013553 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 12:20:53.015288 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.015268 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 11 12:20:53.019273 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.019235 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 12:20:53.020121 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.019344 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-209.ec2.internal.18b8062f569f45f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-209.ec2.internal,UID:ip-10-0-141-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-209.ec2.internal,},FirstTimestamp:2026-06-11 12:20:53.01153944 +0000 UTC m=+0.309915933,LastTimestamp:2026-06-11 12:20:53.01153944 +0000 UTC m=+0.309915933,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-209.ec2.internal,}" Jun 11 12:20:53.021547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.021525 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 12:20:53.021547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.021530 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 12:20:53.021675 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.021611 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.022162 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022146 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 12:20:53.022162 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022162 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 12:20:53.022325 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022225 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 12:20:53.022325 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022322 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 11 12:20:53.022430 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022333 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 11 12:20:53.022933 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022918 2559 factory.go:55] Registering systemd factory Jun 11 12:20:53.022933 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.022933 2559 factory.go:223] Registration of the systemd container factory successfully Jun 11 12:20:53.023143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023132 2559 factory.go:153] Registering CRI-O factory Jun 11 12:20:53.023143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023143 2559 factory.go:223] Registration of the crio container factory successfully Jun 11 12:20:53.023279 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023184 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 12:20:53.023279 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023223 2559 factory.go:103] Registering Raw factory Jun 11 12:20:53.023279 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023240 2559 manager.go:1196] Started watching for new ooms in manager Jun 11 12:20:53.023715 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.023701 2559 manager.go:349] Starting recovery of all containers Jun 11 12:20:53.026788 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.026762 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 12:20:53.027037 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.026873 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 12:20:53.029343 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.029217 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 12:20:53.034503 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.034484 2559 manager.go:354] Recovery completed Jun 11 12:20:53.038064 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.038052 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.040450 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.040420 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.040506 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.040471 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.040506 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.040487 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.041047 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041033 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 12:20:53.041106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041047 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 12:20:53.041106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041063 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:20:53.041106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041075 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.041807 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041788 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-th6g8" Jun 11 12:20:53.041889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041823 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.041889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041846 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.041889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.041856 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.042275 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.042264 2559 policy_none.go:49] "None policy: Start" Jun 11 12:20:53.042325 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.042279 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 12:20:53.042325 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.042290 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 12:20:53.042997 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.042938 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-209.ec2.internal.18b8062f5858712b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-209.ec2.internal,UID:ip-10-0-141-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-209.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-209.ec2.internal,},FirstTimestamp:2026-06-11 12:20:53.040451883 +0000 UTC m=+0.338828385,LastTimestamp:2026-06-11 12:20:53.040451883 +0000 UTC m=+0.338828385,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-209.ec2.internal,}" Jun 11 12:20:53.043280 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.043270 2559 policy_none.go:47] "Start" Jun 11 12:20:53.049983 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.049968 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-th6g8" Jun 11 12:20:53.051599 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.051541 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-209.ec2.internal.18b8062f5858da86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-209.ec2.internal,UID:ip-10-0-141-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-209.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-209.ec2.internal,},FirstTimestamp:2026-06-11 12:20:53.040478854 +0000 UTC m=+0.338855361,LastTimestamp:2026-06-11 12:20:53.040478854 +0000 UTC m=+0.338855361,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-209.ec2.internal,}" Jun 11 12:20:53.076796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.076779 2559 manager.go:337] "Starting Device Plugin manager" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.076809 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.076822 2559 server.go:87] "Starting device plugin registration server" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.077043 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.077053 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.077140 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.077361 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.077372 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.078046 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.078085 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.082617 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.082651 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.082670 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.082697 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 12:20:53.091739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.084627 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:53.177343 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.177311 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.178564 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.178547 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.178679 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.178582 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.178679 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.178599 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.178679 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.178628 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.182972 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.182954 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal"] Jun 11 12:20:53.183028 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.183012 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.184618 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.184602 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.184709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.184630 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.184709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.184644 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.185796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.185780 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.185857 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.185800 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-209.ec2.internal\": node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.187139 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187125 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.187248 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.187302 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187262 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.187880 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187861 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.187880 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187871 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.188032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187889 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.188032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187898 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.188032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187902 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.188032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.187910 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.190346 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.190297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.190346 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.190335 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:53.190986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.190970 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:53.191060 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.190998 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:53.191060 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.191008 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:53.211983 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.211962 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.213886 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.213873 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-209.ec2.internal\" not found" node="ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.218154 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.218138 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-209.ec2.internal\" not found" node="ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.312107 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.312078 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.323413 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.323391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/610d8524ad2ea70151f24165bbc26508-config\") pod \"kube-apiserver-proxy-ip-10-0-141-209.ec2.internal\" (UID: \"610d8524ad2ea70151f24165bbc26508\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.323470 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.323422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.323470 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.323446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.412943 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.412896 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.424290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.424290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.424409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.424409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/610d8524ad2ea70151f24165bbc26508-config\") pod \"kube-apiserver-proxy-ip-10-0-141-209.ec2.internal\" (UID: \"610d8524ad2ea70151f24165bbc26508\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.424409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41836451a499679550df35bf9b599595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal\" (UID: \"41836451a499679550df35bf9b599595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.424409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.424400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/610d8524ad2ea70151f24165bbc26508-config\") pod \"kube-apiserver-proxy-ip-10-0-141-209.ec2.internal\" (UID: \"610d8524ad2ea70151f24165bbc26508\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.513636 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.513571 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.520754 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.520731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.524940 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.524903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:53.614482 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.614441 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.714967 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.714940 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.815603 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.815526 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.862813 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.862787 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:53.916160 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:53.916140 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:53.962625 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.962596 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 12:20:53.963243 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.962756 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:20:53.963243 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:53.962788 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:20:54.016648 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:54.016614 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:54.038671 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:54.038639 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610d8524ad2ea70151f24165bbc26508.slice/crio-a4d23d08c0c4134357ae6c01758a2cc217800157fc6596f6815056f30a3812b7 WatchSource:0}: Error finding container a4d23d08c0c4134357ae6c01758a2cc217800157fc6596f6815056f30a3812b7: Status 404 returned error can't find the container with id a4d23d08c0c4134357ae6c01758a2cc217800157fc6596f6815056f30a3812b7 Jun 11 12:20:54.038875 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:54.038863 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41836451a499679550df35bf9b599595.slice/crio-3c88ec94e7b4137ae18fb6b8471ff16c24e8119d126c0f8b0b3248d5b2b1ad4d WatchSource:0}: Error finding container 3c88ec94e7b4137ae18fb6b8471ff16c24e8119d126c0f8b0b3248d5b2b1ad4d: Status 404 returned error can't find the container with id 3c88ec94e7b4137ae18fb6b8471ff16c24e8119d126c0f8b0b3248d5b2b1ad4d Jun 11 12:20:54.044790 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.044775 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:20:54.052495 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.052466 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 12:15:53 +0000 UTC" deadline="2027-11-24 20:06:35.780700025 +0000 UTC" Jun 11 12:20:54.052495 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.052493 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12751h45m41.728209981s" Jun 11 12:20:54.085891 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.085795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" event={"ID":"610d8524ad2ea70151f24165bbc26508","Type":"ContainerStarted","Data":"a4d23d08c0c4134357ae6c01758a2cc217800157fc6596f6815056f30a3812b7"} Jun 11 12:20:54.086759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.086739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" event={"ID":"41836451a499679550df35bf9b599595","Type":"ContainerStarted","Data":"3c88ec94e7b4137ae18fb6b8471ff16c24e8119d126c0f8b0b3248d5b2b1ad4d"} Jun 11 12:20:54.116920 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:54.116893 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:54.193479 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.193449 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:20:54.194629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.194612 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:20:54.194690 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.194646 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:20:54.194690 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.194657 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:20:54.216971 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:54.216945 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-209.ec2.internal\" not found" Jun 11 12:20:54.281461 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.281439 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:54.321785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.321759 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" Jun 11 12:20:54.331994 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.331976 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:20:54.333111 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.333096 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" Jun 11 12:20:54.344904 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.344840 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:20:54.570959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.570927 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:54.965817 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:54.965784 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:55.002295 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.002262 2559 apiserver.go:52] "Watching apiserver" Jun 11 12:20:55.015064 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.015037 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 12:20:55.016419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.016392 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8k78h","openshift-network-diagnostics/network-check-target-62m6m","openshift-ovn-kubernetes/ovnkube-node-4srhx","kube-system/konnectivity-agent-qmgwj","kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal","openshift-dns/node-resolver-69zsg","openshift-image-registry/node-ca-9d72r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal","openshift-multus/multus-pt89b","openshift-multus/network-metrics-daemon-bcskh","openshift-network-operator/iptables-alerter-rfqbk","kube-system/global-pull-secret-syncer-xwqfn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm","openshift-cluster-node-tuning-operator/tuned-6mcgf"] Jun 11 12:20:55.019114 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.019094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.021134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.021113 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.021943 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.021920 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.022040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.021924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 12:20:55.022040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.021984 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.022150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.022129 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 12:20:55.022368 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.022354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v6t62\"" Jun 11 12:20:55.023675 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.023290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.023675 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.023354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 12:20:55.023675 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.023476 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.023940 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.023923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.023995 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.023947 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c56jm\"" Jun 11 12:20:55.025493 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.025436 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.025984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.025968 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 12:20:55.026970 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.026949 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.026970 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.026969 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5fkz\"" Jun 11 12:20:55.027115 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.027058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 12:20:55.027195 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.027169 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 12:20:55.027195 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.027177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 12:20:55.027381 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.027254 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.027661 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.027633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.028309 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.028190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 12:20:55.028309 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.028284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9zwg\"" Jun 11 12:20:55.028510 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.028481 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 12:20:55.029778 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.029758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.030224 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.030187 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.030826 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.030808 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lhdlv\"" Jun 11 12:20:55.032074 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.032057 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.032470 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.032451 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.033031 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.033010 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.033955 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.033933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7feef61-f359-47fb-bcde-6fb39769cf6a-serviceca\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.034080 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.033970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-netns\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034080 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.033997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-bin\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034080 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg7kq\" (UniqueName: \"kubernetes.io/projected/802956d9-d584-4293-9263-242b36e52b6a-kube-api-access-qg7kq\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.034080 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-systemd-units\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-var-lib-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-etc-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802956d9-d584-4293-9263-242b36e52b6a-host-slash\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-kubelet\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxxd\" (UniqueName: \"kubernetes.io/projected/132a9350-7c1d-406f-82f6-ba47fd061d4b-kube-api-access-cbxxd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034334 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b24vq\"" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7feef61-f359-47fb-bcde-6fb39769cf6a-host\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxmw\" (UniqueName: \"kubernetes.io/projected/d7feef61-f359-47fb-bcde-6fb39769cf6a-kube-api-access-hxxmw\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-log-socket\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-env-overrides\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-systemd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-ovn\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-config\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-slash\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-node-log\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.034610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/802956d9-d584-4293-9263-242b36e52b6a-iptables-alerter-script\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.035290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-netd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.035290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-script-lib\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.035290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.035290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.034723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovn-node-metrics-cert\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.036301 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.036286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 12:20:55.036527 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.036504 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 12:20:55.036610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.036534 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.036610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.036564 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:20:55.037661 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.037639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:55.037775 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.037720 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:20:55.038542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038524 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6rjdl\"" Jun 11 12:20:55.038640 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038609 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.038640 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038633 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.038749 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038526 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 12:20:55.038749 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 12:20:55.038749 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.038742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 12:20:55.039242 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.039223 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-24gst\"" Jun 11 12:20:55.040061 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.040041 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.040148 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.040102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:20:55.042913 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.042741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.045470 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.045316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 12:20:55.045843 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.045818 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zsz48\"" Jun 11 12:20:55.046338 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.046312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 12:20:55.046845 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.046827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.047302 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.047269 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:20:55.061818 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.061800 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kq5f" Jun 11 12:20:55.069756 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.069691 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kq5f" Jun 11 12:20:55.123425 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.123397 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 12:20:55.135261 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-script-lib\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76f11c9b-915f-42d5-af54-b5b63509c584-hosts-file\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.135419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.135419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.135419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-netns\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-socket-dir-parent\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-bin\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135581 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/803d25bc-5008-4c23-a145-7ee8e0de0ca8-konnectivity-ca\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-sys\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-cni-binary-copy\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-bin\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-multus\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-systemd-units\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-etc-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-systemd-units\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-var-lib-kubelet\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-etc-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135803 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-host\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.135860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8865\" (UniqueName: \"kubernetes.io/projected/76f11c9b-915f-42d5-af54-b5b63509c584-kube-api-access-n8865\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-binary-copy\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-dbus\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-script-lib\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-system-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-kubelet\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.135996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7feef61-f359-47fb-bcde-6fb39769cf6a-host\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-log-socket\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-run\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-etc-kubernetes\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-log-socket\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7feef61-f359-47fb-bcde-6fb39769cf6a-host\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-systemd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-kubernetes\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-systemd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.136455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-tmp\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwq5\" (UniqueName: \"kubernetes.io/projected/536a63f2-f517-410b-ab62-6cc3457efaf7-kube-api-access-wzwq5\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76f11c9b-915f-42d5-af54-b5b63509c584-tmp-dir\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-device-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-system-cni-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/802956d9-d584-4293-9263-242b36e52b6a-iptables-alerter-script\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-netd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysconfig\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6875n\" (UniqueName: \"kubernetes.io/projected/454ea5ce-abc2-4341-a088-5d29e59ed4aa-kube-api-access-6875n\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136498 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-cni-netd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovn-node-metrics-cert\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-lib-modules\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.137040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-multus-daemon-config\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs86p\" (UniqueName: \"kubernetes.io/projected/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kube-api-access-vs86p\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-cnibin\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7feef61-f359-47fb-bcde-6fb39769cf6a-serviceca\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-netns\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-kubelet-config\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg7kq\" (UniqueName: \"kubernetes.io/projected/802956d9-d584-4293-9263-242b36e52b6a-kube-api-access-qg7kq\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-var-lib-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-systemd\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-cnibin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136874 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/802956d9-d584-4293-9263-242b36e52b6a-iptables-alerter-script\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-bin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136950 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-var-lib-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.137734 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.136995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn4l7\" (UniqueName: \"kubernetes.io/projected/c9644faf-7413-4d2f-bec0-19b336bdd610-kube-api-access-pn4l7\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802956d9-d584-4293-9263-242b36e52b6a-host-slash\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-kubelet\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxxd\" (UniqueName: \"kubernetes.io/projected/132a9350-7c1d-406f-82f6-ba47fd061d4b-kube-api-access-cbxxd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-os-release\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-os-release\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxmw\" (UniqueName: \"kubernetes.io/projected/d7feef61-f359-47fb-bcde-6fb39769cf6a-kube-api-access-hxxmw\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-env-overrides\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-run-netns\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-kubelet\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-openvswitch\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/803d25bc-5008-4c23-a145-7ee8e0de0ca8-agent-certs\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-ovn\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-config\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-modprobe-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.138558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7feef61-f359-47fb-bcde-6fb39769cf6a-serviceca\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-k8s-cni-cncf-io\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-run-ovn\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-multus-certs\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k64nn\" (UniqueName: \"kubernetes.io/projected/11db1445-3724-4d44-b330-03710a80d342-kube-api-access-k64nn\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802956d9-d584-4293-9263-242b36e52b6a-host-slash\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-slash\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-node-log\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-conf\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-host-slash\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-tuned\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-env-overrides\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-hostroot\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/132a9350-7c1d-406f-82f6-ba47fd061d4b-node-log\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-conf-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.139369 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.137895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovnkube-config\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.140814 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.140793 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/132a9350-7c1d-406f-82f6-ba47fd061d4b-ovn-node-metrics-cert\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.150701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.150679 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg7kq\" (UniqueName: \"kubernetes.io/projected/802956d9-d584-4293-9263-242b36e52b6a-kube-api-access-qg7kq\") pod \"iptables-alerter-rfqbk\" (UID: \"802956d9-d584-4293-9263-242b36e52b6a\") " pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.151026 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.151006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxmw\" (UniqueName: \"kubernetes.io/projected/d7feef61-f359-47fb-bcde-6fb39769cf6a-kube-api-access-hxxmw\") pod \"node-ca-9d72r\" (UID: \"d7feef61-f359-47fb-bcde-6fb39769cf6a\") " pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.151157 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.151142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxxd\" (UniqueName: \"kubernetes.io/projected/132a9350-7c1d-406f-82f6-ba47fd061d4b-kube-api-access-cbxxd\") pod \"ovnkube-node-4srhx\" (UID: \"132a9350-7c1d-406f-82f6-ba47fd061d4b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.238563 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-device-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.238563 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-system-cni-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.238563 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysconfig\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6875n\" (UniqueName: \"kubernetes.io/projected/454ea5ce-abc2-4341-a088-5d29e59ed4aa-kube-api-access-6875n\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-system-cni-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-device-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-lib-modules\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-multus-daemon-config\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysconfig\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.238732 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs86p\" (UniqueName: \"kubernetes.io/projected/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kube-api-access-vs86p\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-lib-modules\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-cnibin\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238731 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.238808 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:20:55.738786323 +0000 UTC m=+3.037162826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.238832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-cnibin\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-kubelet-config\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-systemd\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-kubelet-config\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-cnibin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-systemd\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-bin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.238984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-cnibin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn4l7\" (UniqueName: \"kubernetes.io/projected/c9644faf-7413-4d2f-bec0-19b336bdd610-kube-api-access-pn4l7\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-os-release\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-bin\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-os-release\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.239097 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/803d25bc-5008-4c23-a145-7ee8e0de0ca8-agent-certs\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.239727 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.239144 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:20:55.739128552 +0000 UTC m=+3.037505045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-modprobe-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-k8s-cni-cncf-io\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-multus-certs\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-os-release\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k64nn\" (UniqueName: \"kubernetes.io/projected/11db1445-3724-4d44-b330-03710a80d342-kube-api-access-k64nn\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-conf\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-multus-daemon-config\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-tuned\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-hostroot\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-conf-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76f11c9b-915f-42d5-af54-b5b63509c584-hosts-file\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-conf\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-k8s-cni-cncf-io\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-netns\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.240571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-hostroot\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239535 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76f11c9b-915f-42d5-af54-b5b63509c584-hosts-file\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-modprobe-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-socket-dir-parent\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/803d25bc-5008-4c23-a145-7ee8e0de0ca8-konnectivity-ca\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-os-release\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-sys\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-cni-binary-copy\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9644faf-7413-4d2f-bec0-19b336bdd610-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-multus\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-conf-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-var-lib-kubelet\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239731 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-multus-certs\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.241537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-run-netns\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-host\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-sys\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8865\" (UniqueName: \"kubernetes.io/projected/76f11c9b-915f-42d5-af54-b5b63509c584-kube-api-access-n8865\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-host\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-cni-multus\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-var-lib-kubelet\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-binary-copy\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-dbus\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-system-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.239931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-kubelet\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5202ad3-af7d-4193-92cb-c01fcf386854-dbus\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-system-cni-dir\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240083 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-multus-socket-dir-parent\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240111 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/803d25bc-5008-4c23-a145-7ee8e0de0ca8-konnectivity-ca\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.242127 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-run\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-host-var-lib-kubelet\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-run\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-etc-kubernetes\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-kubernetes\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-tmp\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwq5\" (UniqueName: \"kubernetes.io/projected/536a63f2-f517-410b-ab62-6cc3457efaf7-kube-api-access-wzwq5\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76f11c9b-915f-42d5-af54-b5b63509c584-tmp-dir\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240361 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-cni-binary-copy\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11db1445-3724-4d44-b330-03710a80d342-cni-binary-copy\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-sysctl-d\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240523 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11db1445-3724-4d44-b330-03710a80d342-etc-kubernetes\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-kubernetes\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76f11c9b-915f-42d5-af54-b5b63509c584-tmp-dir\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.240670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9644faf-7413-4d2f-bec0-19b336bdd610-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.241810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/803d25bc-5008-4c23-a145-7ee8e0de0ca8-agent-certs\") pod \"konnectivity-agent-qmgwj\" (UID: \"803d25bc-5008-4c23-a145-7ee8e0de0ca8\") " pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.242355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-etc-tuned\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.242676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.242462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/536a63f2-f517-410b-ab62-6cc3457efaf7-tmp\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.247639 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.247619 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6875n\" (UniqueName: \"kubernetes.io/projected/454ea5ce-abc2-4341-a088-5d29e59ed4aa-kube-api-access-6875n\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.248382 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.248350 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:20:55.248382 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.248375 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:20:55.248550 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.248390 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:55.248550 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.248469 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:20:55.748444716 +0000 UTC m=+3.046821200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:55.249311 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.249289 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn4l7\" (UniqueName: \"kubernetes.io/projected/c9644faf-7413-4d2f-bec0-19b336bdd610-kube-api-access-pn4l7\") pod \"multus-additional-cni-plugins-8k78h\" (UID: \"c9644faf-7413-4d2f-bec0-19b336bdd610\") " pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.249410 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.249318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8865\" (UniqueName: \"kubernetes.io/projected/76f11c9b-915f-42d5-af54-b5b63509c584-kube-api-access-n8865\") pod \"node-resolver-69zsg\" (UID: \"76f11c9b-915f-42d5-af54-b5b63509c584\") " pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.250580 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.250558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k64nn\" (UniqueName: \"kubernetes.io/projected/11db1445-3724-4d44-b330-03710a80d342-kube-api-access-k64nn\") pod \"multus-pt89b\" (UID: \"11db1445-3724-4d44-b330-03710a80d342\") " pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.250580 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.250573 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs86p\" (UniqueName: \"kubernetes.io/projected/e5c78c67-70e7-4bd5-8db5-97b3577dd6d2-kube-api-access-vs86p\") pod \"aws-ebs-csi-driver-node-ftwzm\" (UID: \"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.250726 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.250659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwq5\" (UniqueName: \"kubernetes.io/projected/536a63f2-f517-410b-ab62-6cc3457efaf7-kube-api-access-wzwq5\") pod \"tuned-6mcgf\" (UID: \"536a63f2-f517-410b-ab62-6cc3457efaf7\") " pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.329965 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.329925 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9d72r" Jun 11 12:20:55.339703 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.339681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfqbk" Jun 11 12:20:55.348344 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.348327 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:20:55.353074 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.353045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:20:55.358633 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.358616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" Jun 11 12:20:55.366165 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.366139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-69zsg" Jun 11 12:20:55.372977 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.372960 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pt89b" Jun 11 12:20:55.379549 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.379526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" Jun 11 12:20:55.386052 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.386036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8k78h" Jun 11 12:20:55.743593 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.743564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:55.743750 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.743611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:55.743750 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.743712 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:55.743827 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.743783 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:20:56.743762212 +0000 UTC m=+4.042138707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:55.743827 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.743712 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:55.743911 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.743849 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:20:56.74383586 +0000 UTC m=+4.042212342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:55.844934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:55.844903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:55.845127 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.845093 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:20:55.845127 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.845118 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:20:55.845127 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.845130 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:55.845311 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:55.845192 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:20:56.845171935 +0000 UTC m=+4.143548429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:55.941138 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.940991 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803d25bc_5008_4c23_a145_7ee8e0de0ca8.slice/crio-2853f1af06f27d09d37dbd1603cf1886b66be8fce7947ac4778936bacf0d58f8 WatchSource:0}: Error finding container 2853f1af06f27d09d37dbd1603cf1886b66be8fce7947ac4778936bacf0d58f8: Status 404 returned error can't find the container with id 2853f1af06f27d09d37dbd1603cf1886b66be8fce7947ac4778936bacf0d58f8 Jun 11 12:20:55.960271 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.960241 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802956d9_d584_4293_9263_242b36e52b6a.slice/crio-343f6621c4c306f6f4141a263b1e914d090e10d07df6c450343b2ab430113641 WatchSource:0}: Error finding container 343f6621c4c306f6f4141a263b1e914d090e10d07df6c450343b2ab430113641: Status 404 returned error can't find the container with id 343f6621c4c306f6f4141a263b1e914d090e10d07df6c450343b2ab430113641 Jun 11 12:20:55.961432 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.961404 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132a9350_7c1d_406f_82f6_ba47fd061d4b.slice/crio-3bcabec6040417da8fca6142559daf25c93b03c6caaad617bbde654c62346f06 WatchSource:0}: Error finding container 3bcabec6040417da8fca6142559daf25c93b03c6caaad617bbde654c62346f06: Status 404 returned error can't find the container with id 3bcabec6040417da8fca6142559daf25c93b03c6caaad617bbde654c62346f06 Jun 11 12:20:55.964843 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.964823 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9644faf_7413_4d2f_bec0_19b336bdd610.slice/crio-776ef7c43ce3453bbc92160cf347b50f796dff344e99227f30cae4b982e178d6 WatchSource:0}: Error finding container 776ef7c43ce3453bbc92160cf347b50f796dff344e99227f30cae4b982e178d6: Status 404 returned error can't find the container with id 776ef7c43ce3453bbc92160cf347b50f796dff344e99227f30cae4b982e178d6 Jun 11 12:20:55.965448 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.965426 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7feef61_f359_47fb_bcde_6fb39769cf6a.slice/crio-85cf32c143552189c8c47155e6fa5f2aa7332e069799f1f72aadc30cd80dbf47 WatchSource:0}: Error finding container 85cf32c143552189c8c47155e6fa5f2aa7332e069799f1f72aadc30cd80dbf47: Status 404 returned error can't find the container with id 85cf32c143552189c8c47155e6fa5f2aa7332e069799f1f72aadc30cd80dbf47 Jun 11 12:20:55.966995 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.966871 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f11c9b_915f_42d5_af54_b5b63509c584.slice/crio-2e5352bc22f001a664d892001944ae0498533eb94492bfb22ecf791c45e5c97b WatchSource:0}: Error finding container 2e5352bc22f001a664d892001944ae0498533eb94492bfb22ecf791c45e5c97b: Status 404 returned error can't find the container with id 2e5352bc22f001a664d892001944ae0498533eb94492bfb22ecf791c45e5c97b Jun 11 12:20:55.967568 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.967535 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11db1445_3724_4d44_b330_03710a80d342.slice/crio-5eaadbb483defda0c8c917676abe30d74e7222df959b68ad4f7efb258ad30bd8 WatchSource:0}: Error finding container 5eaadbb483defda0c8c917676abe30d74e7222df959b68ad4f7efb258ad30bd8: Status 404 returned error can't find the container with id 5eaadbb483defda0c8c917676abe30d74e7222df959b68ad4f7efb258ad30bd8 Jun 11 12:20:55.969355 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.969319 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c78c67_70e7_4bd5_8db5_97b3577dd6d2.slice/crio-0071268fbff5992b6eea3d763e19208f8a6871c156a7f6f8278dfa24d643a3d1 WatchSource:0}: Error finding container 0071268fbff5992b6eea3d763e19208f8a6871c156a7f6f8278dfa24d643a3d1: Status 404 returned error can't find the container with id 0071268fbff5992b6eea3d763e19208f8a6871c156a7f6f8278dfa24d643a3d1 Jun 11 12:20:55.970423 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:20:55.970400 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536a63f2_f517_410b_ab62_6cc3457efaf7.slice/crio-049ccd1eb90592b9d5b62b290896db70068c610f47e28151f7c98460dab91c33 WatchSource:0}: Error finding container 049ccd1eb90592b9d5b62b290896db70068c610f47e28151f7c98460dab91c33: Status 404 returned error can't find the container with id 049ccd1eb90592b9d5b62b290896db70068c610f47e28151f7c98460dab91c33 Jun 11 12:20:56.073090 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.073064 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:15:55 +0000 UTC" deadline="2028-03-18 21:46:20.336852918 +0000 UTC" Jun 11 12:20:56.073090 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.073089 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15513h25m24.263767041s" Jun 11 12:20:56.098199 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.098169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" event={"ID":"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2","Type":"ContainerStarted","Data":"0071268fbff5992b6eea3d763e19208f8a6871c156a7f6f8278dfa24d643a3d1"} Jun 11 12:20:56.099346 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.099294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69zsg" event={"ID":"76f11c9b-915f-42d5-af54-b5b63509c584","Type":"ContainerStarted","Data":"2e5352bc22f001a664d892001944ae0498533eb94492bfb22ecf791c45e5c97b"} Jun 11 12:20:56.100283 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.100261 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pt89b" event={"ID":"11db1445-3724-4d44-b330-03710a80d342","Type":"ContainerStarted","Data":"5eaadbb483defda0c8c917676abe30d74e7222df959b68ad4f7efb258ad30bd8"} Jun 11 12:20:56.101745 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.101720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfqbk" event={"ID":"802956d9-d584-4293-9263-242b36e52b6a","Type":"ContainerStarted","Data":"343f6621c4c306f6f4141a263b1e914d090e10d07df6c450343b2ab430113641"} Jun 11 12:20:56.105089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.105059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" event={"ID":"536a63f2-f517-410b-ab62-6cc3457efaf7","Type":"ContainerStarted","Data":"049ccd1eb90592b9d5b62b290896db70068c610f47e28151f7c98460dab91c33"} Jun 11 12:20:56.109941 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.109915 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9d72r" event={"ID":"d7feef61-f359-47fb-bcde-6fb39769cf6a","Type":"ContainerStarted","Data":"85cf32c143552189c8c47155e6fa5f2aa7332e069799f1f72aadc30cd80dbf47"} Jun 11 12:20:56.110891 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.110871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerStarted","Data":"776ef7c43ce3453bbc92160cf347b50f796dff344e99227f30cae4b982e178d6"} Jun 11 12:20:56.111877 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.111857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"3bcabec6040417da8fca6142559daf25c93b03c6caaad617bbde654c62346f06"} Jun 11 12:20:56.115113 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.115095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmgwj" event={"ID":"803d25bc-5008-4c23-a145-7ee8e0de0ca8","Type":"ContainerStarted","Data":"2853f1af06f27d09d37dbd1603cf1886b66be8fce7947ac4778936bacf0d58f8"} Jun 11 12:20:56.117961 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.117942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" event={"ID":"610d8524ad2ea70151f24165bbc26508","Type":"ContainerStarted","Data":"85f40ecf0503b4178e5e122d6c1f499e83fb300088ac5d359fff5c9cddc262e4"} Jun 11 12:20:56.125145 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.125126 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:20:56.134694 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.134659 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-209.ec2.internal" podStartSLOduration=2.134647678 podStartE2EDuration="2.134647678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:20:56.134139315 +0000 UTC m=+3.432515819" watchObservedRunningTime="2026-06-11 12:20:56.134647678 +0000 UTC m=+3.433024179" Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.752258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.752325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.752463 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.752529 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:20:58.752510341 +0000 UTC m=+6.050886828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.752932 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:56.753065 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.752980 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:20:58.752965253 +0000 UTC m=+6.051341738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:56.853064 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:56.852981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:56.853375 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.853135 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:20:56.853375 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.853163 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:20:56.853375 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.853178 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:56.853375 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:56.853260 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:20:58.853239817 +0000 UTC m=+6.151616300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:57.073866 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.073752 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:15:55 +0000 UTC" deadline="2028-01-18 02:17:19.704137875 +0000 UTC" Jun 11 12:20:57.073866 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.073815 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14053h56m22.63032665s" Jun 11 12:20:57.085955 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.085932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:57.086087 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:57.086052 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:20:57.086473 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.086455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:57.086584 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:57.086562 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:20:57.086674 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.086623 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:57.086726 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:57.086692 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:20:57.134119 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.134081 2559 generic.go:356] "Generic (PLEG): container finished" podID="41836451a499679550df35bf9b599595" containerID="4dd14a23f79d593224fab1929931533509677be53e56be9f86718eae0b70c25c" exitCode=0 Jun 11 12:20:57.135065 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:57.134993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" event={"ID":"41836451a499679550df35bf9b599595","Type":"ContainerDied","Data":"4dd14a23f79d593224fab1929931533509677be53e56be9f86718eae0b70c25c"} Jun 11 12:20:58.165290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:58.162694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" event={"ID":"41836451a499679550df35bf9b599595","Type":"ContainerStarted","Data":"279c15c71298c776f9854c96dafe74ead585f36946034333559d107e04413793"} Jun 11 12:20:58.179220 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:58.179155 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-209.ec2.internal" podStartSLOduration=4.179135069 podStartE2EDuration="4.179135069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:20:58.178194701 +0000 UTC m=+5.476571204" watchObservedRunningTime="2026-06-11 12:20:58.179135069 +0000 UTC m=+5.477511572" Jun 11 12:20:58.772552 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:58.772509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:58.772747 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:58.772584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:58.772747 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.772685 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:58.772747 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.772725 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:58.772963 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.772764 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:02.772743475 +0000 UTC m=+10.071119971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:20:58.772963 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.772820 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:21:02.772774491 +0000 UTC m=+10.071150976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:20:58.873400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:58.873364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:58.873600 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.873534 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:20:58.873600 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.873553 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:20:58.873600 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.873565 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:58.873786 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:58.873622 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:21:02.873605277 +0000 UTC m=+10.171981759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:20:59.084054 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:59.083960 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:20:59.084054 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:59.084008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:20:59.084330 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:59.084102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:20:59.084330 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:20:59.084180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:20:59.084658 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:59.084623 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:20:59.085149 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:20:59.085117 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:01.083804 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:01.083771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:01.084275 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:01.083817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:01.084275 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:01.083783 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:01.084275 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:01.083911 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:01.084275 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:01.084008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:01.084275 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:01.084065 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:02.809992 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:02.809943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:02.810494 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:02.810010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:02.810494 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.810126 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:02.810494 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.810183 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:02.810494 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.810190 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:21:10.810170387 +0000 UTC m=+18.108546873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:02.810494 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.810271 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:10.810253751 +0000 UTC m=+18.108630236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:02.910546 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:02.910508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:02.910747 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.910723 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:02.910853 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.910756 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:02.910853 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.910771 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:02.910853 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:02.910835 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:21:10.910816301 +0000 UTC m=+18.209192782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:03.083806 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:03.083914 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:03.083977 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:03.084070 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:03.084108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:03.084312 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:03.084166 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:05.083700 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:05.083605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:05.084194 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:05.083741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:05.084194 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:05.083787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:05.084194 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:05.083741 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:05.084194 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:05.083878 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:05.084194 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:05.083973 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:07.083179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:07.083142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:07.083179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:07.083176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:07.083723 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:07.083144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:07.083723 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:07.083293 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:07.083723 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:07.083406 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:07.083723 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:07.083484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:09.083092 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:09.083057 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:09.083092 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:09.083080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:09.083605 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:09.083057 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:09.083605 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:09.083228 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:09.083605 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:09.083327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:09.083605 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:09.083418 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:10.867387 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:10.867360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:10.867733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:10.867405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:10.867733 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.867506 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:10.867733 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.867558 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:21:26.867542619 +0000 UTC m=+34.165919100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:10.867733 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.867504 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:10.867733 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.867656 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:26.867636527 +0000 UTC m=+34.166013029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:10.968631 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:10.968600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:10.968806 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.968766 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:10.968806 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.968789 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:10.968806 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.968802 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:10.968953 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:10.968856 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:21:26.968840605 +0000 UTC m=+34.267217086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:11.083726 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:11.083693 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:11.083903 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:11.083865 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:11.083984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:11.083934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:11.084071 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:11.084049 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:11.084140 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:11.084099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:11.084183 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:11.084170 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:13.083883 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:13.083852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:13.084440 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:13.083953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:13.084440 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:13.083959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:13.084440 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:13.084094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:13.084440 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:13.084109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:13.084440 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:13.084188 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:15.083768 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:15.083737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:15.084189 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:15.083773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:15.084189 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:15.083737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:15.084189 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:15.083847 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:15.084189 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:15.083943 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:15.084189 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:15.084026 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:16.202707 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.202237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" event={"ID":"536a63f2-f517-410b-ab62-6cc3457efaf7","Type":"ContainerStarted","Data":"d56cf215129973cdc60c7dfea730088f76b3a2ca12c09303de1a6ac0371153c7"} Jun 11 12:21:16.204066 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.203912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9d72r" event={"ID":"d7feef61-f359-47fb-bcde-6fb39769cf6a","Type":"ContainerStarted","Data":"f0b5a3cb1693db6b5150980872b1cf38f816d3b5797f7fe492c748179e100eb7"} Jun 11 12:21:16.205944 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.205841 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="97b72ecf662c28fe1062b4ea84064d2eed7698531194de5bf6a0b0fd24f8f25e" exitCode=0 Jun 11 12:21:16.205944 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.205884 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"97b72ecf662c28fe1062b4ea84064d2eed7698531194de5bf6a0b0fd24f8f25e"} Jun 11 12:21:16.209298 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209281 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:21:16.209727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209693 2559 generic.go:356] "Generic (PLEG): container finished" podID="132a9350-7c1d-406f-82f6-ba47fd061d4b" containerID="57962b089ddd5f2abb0263a22aa70a2eb57cf2899bf3edff1df757482197e9d6" exitCode=1 Jun 11 12:21:16.209822 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209771 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"18392da0d0d44e0707b18fc443387d81037844e67defcc8e931466958a911356"} Jun 11 12:21:16.209885 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"c8947ef54ea85893901021e9c3378300d0623e01126d574318960b7558d85c18"} Jun 11 12:21:16.209946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209902 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"a1b2073c6815994a12cde8827e2c27caace337921169f367b67738272833d838"} Jun 11 12:21:16.210000 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.209953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"d21238263677fe3480f19ec212026429df8d177260054b61e0a3270139ecb184"} Jun 11 12:21:16.210053 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.210002 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerDied","Data":"57962b089ddd5f2abb0263a22aa70a2eb57cf2899bf3edff1df757482197e9d6"} Jun 11 12:21:16.210107 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.210055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"88d853c5fda5f9310c3453fa39d11d3f365a612b8af04972b844ec65f509d003"} Jun 11 12:21:16.211635 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.211555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmgwj" event={"ID":"803d25bc-5008-4c23-a145-7ee8e0de0ca8","Type":"ContainerStarted","Data":"68fa4f37bb5b2d5afbbc9af72d28259e46d8e8f210e3d32214d8c3837c762096"} Jun 11 12:21:16.213176 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.213156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" event={"ID":"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2","Type":"ContainerStarted","Data":"385efa866b93da4cfd682fcaba2243e6367147bc6f8e4d9294d3a6442c3f75d4"} Jun 11 12:21:16.214528 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.214501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-69zsg" event={"ID":"76f11c9b-915f-42d5-af54-b5b63509c584","Type":"ContainerStarted","Data":"d3b3c5b345f77a907f5fce60afd5a4ab38f7b5e085f49caf159811debf40f8d9"} Jun 11 12:21:16.215959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.215942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pt89b" event={"ID":"11db1445-3724-4d44-b330-03710a80d342","Type":"ContainerStarted","Data":"93bd4f2ffb45bcae9f8e03262a4594434b99316f17a9157778cf86d9eee74f86"} Jun 11 12:21:16.233427 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.233383 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6mcgf" podStartSLOduration=4.089112004 podStartE2EDuration="23.233370753s" totalImagesPullingTime="19.144258749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.219078435 +0000 UTC m=+23.517454938" watchObservedRunningTime="2026-06-11 12:21:16.233370753 +0000 UTC m=+23.531747254" Jun 11 12:21:16.265358 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.265311 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-69zsg" podStartSLOduration=4.11373997 podStartE2EDuration="23.265294486s" totalImagesPullingTime="19.151554516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.233191302 +0000 UTC m=+23.531567795" watchObservedRunningTime="2026-06-11 12:21:16.265294486 +0000 UTC m=+23.563670987" Jun 11 12:21:16.283754 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.283706 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9d72r" podStartSLOduration=4.13638015 podStartE2EDuration="23.283692815s" totalImagesPullingTime="19.147312665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.283463072 +0000 UTC m=+23.581839574" watchObservedRunningTime="2026-06-11 12:21:16.283692815 +0000 UTC m=+23.582069316" Jun 11 12:21:16.298493 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.298453 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qmgwj" podStartSLOduration=4.202164536 podStartE2EDuration="23.298441503s" totalImagesPullingTime="19.096276967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.29811783 +0000 UTC m=+23.596494342" watchObservedRunningTime="2026-06-11 12:21:16.298441503 +0000 UTC m=+23.596818004" Jun 11 12:21:16.319136 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.319092 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pt89b" podStartSLOduration=4.094325933 podStartE2EDuration="23.319075705s" totalImagesPullingTime="19.224749772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:16.318655482 +0000 UTC m=+23.617031986" watchObservedRunningTime="2026-06-11 12:21:16.319075705 +0000 UTC m=+23.617452207" Jun 11 12:21:16.609533 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.609497 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 12:21:16.633878 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.633858 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:21:16.634429 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:16.634410 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:21:17.083659 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.083139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:17.083659 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.083139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:17.083659 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:17.083532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:17.083659 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.083169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:17.083659 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:17.083591 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:17.084153 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:17.083675 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:17.086951 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.086852 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T12:21:16.609517913Z","UUID":"d489d175-edd7-43eb-a8d6-39b1025d0bb7","Handler":null,"Name":"","Endpoint":""} Jun 11 12:21:17.088837 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.088812 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 12:21:17.088961 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.088855 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 12:21:17.220512 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.220459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" event={"ID":"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2","Type":"ContainerStarted","Data":"32083826bea21f28358283f7cc71bedec3aa2837feacb5d426761895ec499ecf"} Jun 11 12:21:17.222150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.222101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfqbk" event={"ID":"802956d9-d584-4293-9263-242b36e52b6a","Type":"ContainerStarted","Data":"4f8eca7ce6f65161f67478637f3f40aaff7d966cd392ee43f55b46944a88393e"} Jun 11 12:21:17.222960 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.222868 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:21:17.224192 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.224172 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:21:17.238321 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:17.238269 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rfqbk" podStartSLOduration=5.085755633 podStartE2EDuration="24.238251381s" totalImagesPullingTime="19.152495748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:17.238201541 +0000 UTC m=+24.536578044" watchObservedRunningTime="2026-06-11 12:21:17.238251381 +0000 UTC m=+24.536627887" Jun 11 12:21:18.228107 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:18.228057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" event={"ID":"e5c78c67-70e7-4bd5-8db5-97b3577dd6d2","Type":"ContainerStarted","Data":"f4c447df4e386710a8503e77d3ea29fec6a18ed2f12daa3ba574616d762ee35a"} Jun 11 12:21:18.246202 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:18.246156 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftwzm" podStartSLOduration=4.112260516 podStartE2EDuration="25.24614201s" totalImagesPullingTime="21.133881494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:18.245809494 +0000 UTC m=+25.544186000" watchObservedRunningTime="2026-06-11 12:21:18.24614201 +0000 UTC m=+25.544518512" Jun 11 12:21:19.083513 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:19.083481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:19.083703 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:19.083491 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:19.083703 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:19.083618 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:19.083703 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:19.083491 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:19.083703 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:19.083685 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:19.083906 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:19.083747 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:19.233684 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:19.233654 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:21:19.234321 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:19.234096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"5718b162cb28a316ea2932418e700530f72c3462e2d6d1f9fd74ef0e7db7aceb"} Jun 11 12:21:21.083549 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.083377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:21.084104 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.083377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:21.084104 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:21.083626 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:21.084104 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.083430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:21.084104 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:21.083705 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:21.084104 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:21.083801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:21.240183 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.240151 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="f46872cd0489e5f590d7579b113c0751f3372cd6d5d69e0eb69caae1ef86d590" exitCode=0 Jun 11 12:21:21.240390 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.240239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"f46872cd0489e5f590d7579b113c0751f3372cd6d5d69e0eb69caae1ef86d590"} Jun 11 12:21:21.243788 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.243772 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:21:21.244106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.244088 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"14ea58ea1cbe4555776cff941aed70fc4fa53f8ce88d9fed284beec7caa724d8"} Jun 11 12:21:21.244416 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.244396 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:21.244508 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.244472 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:21.244633 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.244557 2559 scope.go:117] "RemoveContainer" containerID="57962b089ddd5f2abb0263a22aa70a2eb57cf2899bf3edff1df757482197e9d6" Jun 11 12:21:21.261025 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.261002 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:21.261629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:21.261612 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:22.250147 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.250124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:21:22.250761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.250453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" event={"ID":"132a9350-7c1d-406f-82f6-ba47fd061d4b","Type":"ContainerStarted","Data":"f0593ce8dc1ca757fd1ea467ed2150c843dfefc6d397e55d3422cd728a614d31"} Jun 11 12:21:22.250761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.250539 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 12:21:22.285905 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.285858 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" podStartSLOduration=9.851696258 podStartE2EDuration="29.285842009s" totalImagesPullingTime="19.434145751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:22.28449346 +0000 UTC m=+29.582869961" watchObservedRunningTime="2026-06-11 12:21:22.285842009 +0000 UTC m=+29.584218511" Jun 11 12:21:22.540388 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.540147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62m6m"] Jun 11 12:21:22.540575 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.540437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:22.540575 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:22.540525 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:22.543327 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.543297 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcskh"] Jun 11 12:21:22.543451 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.543417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:22.543547 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:22.543527 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:22.543854 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.543833 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwqfn"] Jun 11 12:21:22.543952 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.543937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:22.544051 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:22.544029 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:22.703712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:22.703687 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:23.254904 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:23.254869 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="7d8db76f82d1de47f4c2bdb997971ab35ffa8bea7aae824438d4811daaa379c4" exitCode=0 Jun 11 12:21:23.255306 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:23.254945 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"7d8db76f82d1de47f4c2bdb997971ab35ffa8bea7aae824438d4811daaa379c4"} Jun 11 12:21:24.083233 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:24.083182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:24.083425 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:24.083238 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:24.083425 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:24.083318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:24.083425 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:24.083329 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:24.083425 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:24.083414 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:24.083621 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:24.083516 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:25.261636 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:25.261546 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="6b74f1a0dbeb7ea3494102159f0b726d16720b5f7ec10ee384dbfedff17a81c8" exitCode=0 Jun 11 12:21:25.261636 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:25.261608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"6b74f1a0dbeb7ea3494102159f0b726d16720b5f7ec10ee384dbfedff17a81c8"} Jun 11 12:21:26.083403 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.083371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:26.083595 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.083478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:26.083595 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.083489 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:26.083595 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.083506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:26.083595 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.083582 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:26.083810 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.083665 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:26.880199 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.880168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:26.880637 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.880230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:26.880637 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.880330 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:26.880637 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.880333 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:26.880637 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.880384 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:21:58.880368669 +0000 UTC m=+66.178745149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:21:26.880637 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.880398 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret podName:a5202ad3-af7d-4193-92cb-c01fcf386854 nodeName:}" failed. No retries permitted until 2026-06-11 12:21:58.88039185 +0000 UTC m=+66.178768330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret") pod "global-pull-secret-syncer-xwqfn" (UID: "a5202ad3-af7d-4193-92cb-c01fcf386854") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:21:26.981152 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:26.981118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:26.981329 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.981291 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:21:26.981329 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.981313 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:21:26.981329 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.981325 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9mlgn for pod openshift-network-diagnostics/network-check-target-62m6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:26.981456 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:26.981385 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn podName:bf537205-af67-4c20-9da5-243fadca809b nodeName:}" failed. No retries permitted until 2026-06-11 12:21:58.981367038 +0000 UTC m=+66.279743523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9mlgn" (UniqueName: "kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn") pod "network-check-target-62m6m" (UID: "bf537205-af67-4c20-9da5-243fadca809b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:21:28.083022 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:28.082979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:28.083603 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:28.082985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:28.083603 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:28.083104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62m6m" podUID="bf537205-af67-4c20-9da5-243fadca809b" Jun 11 12:21:28.083603 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:28.082985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:28.083603 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:28.083229 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:21:28.083603 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:28.083342 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwqfn" podUID="a5202ad3-af7d-4193-92cb-c01fcf386854" Jun 11 12:21:29.002445 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.002375 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-209.ec2.internal" event="NodeReady" Jun 11 12:21:29.002596 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.002511 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 12:21:29.038849 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.038807 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:21:29.042615 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.042592 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.045504 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.045473 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksp79\"" Jun 11 12:21:29.045662 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.045642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 12:21:29.045748 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.045702 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 12:21:29.045807 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.045757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 12:21:29.052706 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.052645 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xpf2j"] Jun 11 12:21:29.054954 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.054921 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 12:21:29.056474 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.056457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.058852 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.058830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 12:21:29.058973 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.058902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 12:21:29.059133 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.059116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54jbl\"" Jun 11 12:21:29.066416 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.066393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:21:29.069505 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.069480 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xpf2j"] Jun 11 12:21:29.088564 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.088533 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-59252"] Jun 11 12:21:29.091144 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.091126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.094755 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.094734 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 12:21:29.094755 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.094746 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 12:21:29.094918 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.094742 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 12:21:29.094918 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.094867 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dpbzd\"" Jun 11 12:21:29.115257 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.115236 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59252"] Jun 11 12:21:29.174783 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.174744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.196783 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.196749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgt24\" (UniqueName: \"kubernetes.io/projected/8c1a4ff3-4173-40a4-a0e5-162d7df22396-kube-api-access-vgt24\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.196949 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.196811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9j5s\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.196949 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.196897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.196949 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.196928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c1a4ff3-4173-40a4-a0e5-162d7df22396-cert\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.197089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.196975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8d62\" (UniqueName: \"kubernetes.io/projected/749d36cc-42b9-45e5-8142-b45dcb27f05f-kube-api-access-s8d62\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.197089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.197089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/749d36cc-42b9-45e5-8142-b45dcb27f05f-config-volume\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.197261 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.197261 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.197261 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749d36cc-42b9-45e5-8142-b45dcb27f05f-tmp-dir\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.197452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.197452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.197452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.197452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.197363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.279640 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.279555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.298648 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.298616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.298648 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.298658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.298872 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.298688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.298872 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.298826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.298972 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.298873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgt24\" (UniqueName: \"kubernetes.io/projected/8c1a4ff3-4173-40a4-a0e5-162d7df22396-kube-api-access-vgt24\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.298972 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.298893 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:29.298972 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.298914 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:29.299098 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.298995 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:21:29.798970784 +0000 UTC m=+37.097347303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:29.299259 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9j5s\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299323 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299323 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c1a4ff3-4173-40a4-a0e5-162d7df22396-cert\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.299428 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8d62\" (UniqueName: \"kubernetes.io/projected/749d36cc-42b9-45e5-8142-b45dcb27f05f-kube-api-access-s8d62\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.299428 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299428 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/749d36cc-42b9-45e5-8142-b45dcb27f05f-config-volume\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.299573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.299573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749d36cc-42b9-45e5-8142-b45dcb27f05f-tmp-dir\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.299699 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299965 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.299873 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:29.299965 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.299965 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749d36cc-42b9-45e5-8142-b45dcb27f05f-tmp-dir\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.299965 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.299945 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:21:29.799926087 +0000 UTC m=+37.098302581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:29.300168 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.299970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.300168 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.300117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/749d36cc-42b9-45e5-8142-b45dcb27f05f-config-volume\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.303748 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.303620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c1a4ff3-4173-40a4-a0e5-162d7df22396-cert\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.303867 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.303618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.303867 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.303621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.310255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.310185 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.310368 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.310318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8d62\" (UniqueName: \"kubernetes.io/projected/749d36cc-42b9-45e5-8142-b45dcb27f05f-kube-api-access-s8d62\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.310553 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.310520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9j5s\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.310855 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.310833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgt24\" (UniqueName: \"kubernetes.io/projected/8c1a4ff3-4173-40a4-a0e5-162d7df22396-kube-api-access-vgt24\") pod \"ingress-canary-59252\" (UID: \"8c1a4ff3-4173-40a4-a0e5-162d7df22396\") " pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.379601 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.379570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.400700 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.400681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59252" Jun 11 12:21:29.512830 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.512800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.560255 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.560224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59252"] Jun 11 12:21:29.564831 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:21:29.564795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1a4ff3_4173_40a4_a0e5_162d7df22396.slice/crio-cc667b624a0b502275bcb7cd6c733d9b40227b5192bac4c90cc68e6a4c829c0e WatchSource:0}: Error finding container cc667b624a0b502275bcb7cd6c733d9b40227b5192bac4c90cc68e6a4c829c0e: Status 404 returned error can't find the container with id cc667b624a0b502275bcb7cd6c733d9b40227b5192bac4c90cc68e6a4c829c0e Jun 11 12:21:29.613939 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.613918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.691970 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.691935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:29.803701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.803614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:29.803701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:29.803664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:29.803893 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.803774 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:29.803893 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.803844 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:21:30.803829663 +0000 UTC m=+38.102206146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:29.803893 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.803778 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:29.803893 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.803879 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:29.804023 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:29.803917 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:21:30.803906797 +0000 UTC m=+38.102283294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:30.083322 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.083246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:30.083489 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.083246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:30.083489 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.083246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087507 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087536 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v492\"" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087480 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jffg2\"" Jun 11 12:21:30.087650 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.087538 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:21:30.277570 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.277533 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="4f546b44ebae65393c2737bfd671ae6ea5e35f18cf3ea75e254437eb9f5e043a" exitCode=0 Jun 11 12:21:30.278028 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.277637 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"4f546b44ebae65393c2737bfd671ae6ea5e35f18cf3ea75e254437eb9f5e043a"} Jun 11 12:21:30.279038 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.279017 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59252" event={"ID":"8c1a4ff3-4173-40a4-a0e5-162d7df22396","Type":"ContainerStarted","Data":"cc667b624a0b502275bcb7cd6c733d9b40227b5192bac4c90cc68e6a4c829c0e"} Jun 11 12:21:30.312339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.312310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:30.374852 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.374825 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:30.711811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.711609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:30.769382 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.769354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:30.813913 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.813882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:30.814060 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:30.813934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:30.814060 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:30.814046 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:30.814144 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:30.814083 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:30.814144 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:30.814096 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:30.814144 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:30.814124 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:21:32.814102667 +0000 UTC m=+40.112479178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:30.814305 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:30.814153 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:21:32.814137918 +0000 UTC m=+40.112514423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:31.285476 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.285435 2559 generic.go:356] "Generic (PLEG): container finished" podID="c9644faf-7413-4d2f-bec0-19b336bdd610" containerID="51af72373eef0759c429909052fe435cfdb90fcab73d81c1429ed507f1a9795a" exitCode=0 Jun 11 12:21:31.285996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.285516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerDied","Data":"51af72373eef0759c429909052fe435cfdb90fcab73d81c1429ed507f1a9795a"} Jun 11 12:21:31.518224 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.518156 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:31.733679 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.733649 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:31.790707 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.790639 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:31.917519 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:31.917492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.017610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.017579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.289264 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.289168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59252" event={"ID":"8c1a4ff3-4173-40a4-a0e5-162d7df22396","Type":"ContainerStarted","Data":"89accacc3d0bf2ceb3080354f61aae239a9d976602aa82257a4f5dd56b8a83c8"} Jun 11 12:21:32.292452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.292428 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8k78h" event={"ID":"c9644faf-7413-4d2f-bec0-19b336bdd610","Type":"ContainerStarted","Data":"2a77b6862a91e3ddce3ec69a660fac53fd328384d1850bd7fd0ffec3c067bf97"} Jun 11 12:21:32.308865 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.308508 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-59252" podStartSLOduration=1.226303064 podStartE2EDuration="3.308486645s" totalImagesPullingTime="2.082183581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:32.307347643 +0000 UTC m=+39.605724146" watchObservedRunningTime="2026-06-11 12:21:32.308486645 +0000 UTC m=+39.606863147" Jun 11 12:21:32.334632 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.334574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8k78h" podStartSLOduration=10.054367784 podStartE2EDuration="39.334550833s" totalImagesPullingTime="29.280183049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:21:32.332665781 +0000 UTC m=+39.631042284" watchObservedRunningTime="2026-06-11 12:21:32.334550833 +0000 UTC m=+39.632927336" Jun 11 12:21:32.361969 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.361931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.420591 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.420558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.723494 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.723465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.790678 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.790644 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:32.830171 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.830139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:32.830365 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:32.830235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:32.830365 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:32.830318 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:32.830365 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:32.830342 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:32.830365 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:32.830324 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:32.830523 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:32.830393 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:21:36.830379883 +0000 UTC m=+44.128756363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:32.830523 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:32.830406 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:21:36.830400312 +0000 UTC m=+44.128776792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:33.122063 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:33.121980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:33.180023 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:33.179991 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:36.862785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:36.862746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:36.862901 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:36.862922 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:36.862920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:36.862972 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:21:44.862958468 +0000 UTC m=+52.161334973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:36.863024 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:36.863234 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:36.863064 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:21:44.863053695 +0000 UTC m=+52.161430175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:43.454263 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:43.454227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:44.918155 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:44.918120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:44.918224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:44.918327 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:44.918354 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:44.918406 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:22:00.918390529 +0000 UTC m=+68.216767008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:44.918331 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:21:44.918586 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:44.918469 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:22:00.918457821 +0000 UTC m=+68.216834302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:21:48.259254 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:48.259190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:48.314310 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:48.314283 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:49.592911 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:49.592881 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:49.651221 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:49.651187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" limit=1024 Jun 11 12:21:54.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:54.267675 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4srhx" Jun 11 12:21:58.918265 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:58.918221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:58.918760 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:58.918276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:21:58.921440 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:58.921416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:21:58.921545 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:58.921418 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:21:58.928889 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:58.928872 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:21:58.928961 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:21:58.928949 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:23:02.928928205 +0000 UTC m=+130.227304699 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : secret "metrics-daemon-secret" not found Jun 11 12:21:58.932155 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:58.932137 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5202ad3-af7d-4193-92cb-c01fcf386854-original-pull-secret\") pod \"global-pull-secret-syncer-xwqfn\" (UID: \"a5202ad3-af7d-4193-92cb-c01fcf386854\") " pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:59.018801 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.018769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:59.021761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.021742 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:21:59.032571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.032552 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:21:59.042878 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.042857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mlgn\" (UniqueName: \"kubernetes.io/projected/bf537205-af67-4c20-9da5-243fadca809b-kube-api-access-9mlgn\") pod \"network-check-target-62m6m\" (UID: \"bf537205-af67-4c20-9da5-243fadca809b\") " pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:59.204453 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.204347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwqfn" Jun 11 12:21:59.212751 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.212088 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jffg2\"" Jun 11 12:21:59.220221 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.220180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:21:59.344237 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.344188 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwqfn"] Jun 11 12:21:59.347918 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:21:59.347892 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5202ad3_af7d_4193_92cb_c01fcf386854.slice/crio-36a37f0dc09d0846123f6f5e50d6f6d9927072799f40e89c74a912cf4a8cc70f WatchSource:0}: Error finding container 36a37f0dc09d0846123f6f5e50d6f6d9927072799f40e89c74a912cf4a8cc70f: Status 404 returned error can't find the container with id 36a37f0dc09d0846123f6f5e50d6f6d9927072799f40e89c74a912cf4a8cc70f Jun 11 12:21:59.355660 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.355638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwqfn" event={"ID":"a5202ad3-af7d-4193-92cb-c01fcf386854","Type":"ContainerStarted","Data":"36a37f0dc09d0846123f6f5e50d6f6d9927072799f40e89c74a912cf4a8cc70f"} Jun 11 12:21:59.358537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:21:59.358516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62m6m"] Jun 11 12:21:59.361378 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:21:59.361355 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf537205_af67_4c20_9da5_243fadca809b.slice/crio-eda0d9c9534dc50cc288f733b872d33c2c5731fec6045a9903a5f9aea3918ce1 WatchSource:0}: Error finding container eda0d9c9534dc50cc288f733b872d33c2c5731fec6045a9903a5f9aea3918ce1: Status 404 returned error can't find the container with id eda0d9c9534dc50cc288f733b872d33c2c5731fec6045a9903a5f9aea3918ce1 Jun 11 12:22:00.360067 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:00.360026 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62m6m" event={"ID":"bf537205-af67-4c20-9da5-243fadca809b","Type":"ContainerStarted","Data":"eda0d9c9534dc50cc288f733b872d33c2c5731fec6045a9903a5f9aea3918ce1"} Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:00.934743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:00.934845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:00.934868 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:00.934885 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:00.934954 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:22:00.935002 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:00.935001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:22:32.934981435 +0000 UTC m=+100.233357937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:22:00.935490 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:00.935019 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:22:32.935010734 +0000 UTC m=+100.233387214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:22:02.367111 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:02.367075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62m6m" event={"ID":"bf537205-af67-4c20-9da5-243fadca809b","Type":"ContainerStarted","Data":"6b5cba0f9d05b0a2989c95412d843903dbb7336014d141b9b8a31be1a97a631e"} Jun 11 12:22:02.367500 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:02.367325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:22:05.375582 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:05.375536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwqfn" event={"ID":"a5202ad3-af7d-4193-92cb-c01fcf386854","Type":"ContainerStarted","Data":"084545cd5e25aa082dff8b1641d8784fceb5590ca25bcc269b0199f0a3a51d35"} Jun 11 12:22:05.391837 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:05.391788 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xwqfn" podStartSLOduration=67.245052695 podStartE2EDuration="1m12.39177329s" totalImagesPullingTime="5.146720595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:05.39123258 +0000 UTC m=+72.689609079" watchObservedRunningTime="2026-06-11 12:22:05.39177329 +0000 UTC m=+72.690149791" Jun 11 12:22:05.391975 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:05.391955 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-62m6m" podStartSLOduration=69.472855877 podStartE2EDuration="1m12.391949644s" totalImagesPullingTime="2.919093767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:02.384753688 +0000 UTC m=+69.683130202" watchObservedRunningTime="2026-06-11 12:22:05.391949644 +0000 UTC m=+72.690326155" Jun 11 12:22:32.955835 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:32.955787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:22:32.955835 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:32.955844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:22:32.956360 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:32.955940 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:22:32.956360 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:32.955953 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:22:32.956360 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:32.955964 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:22:32.956360 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:32.956014 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:23:36.956000046 +0000 UTC m=+164.254376526 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:22:32.956360 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:22:32.956026 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:23:36.956020289 +0000 UTC m=+164.254396768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:22:33.372528 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:33.372450 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-62m6m" Jun 11 12:22:54.227317 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.227280 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn"] Jun 11 12:22:54.229599 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.229581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.232244 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.232220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 12:22:54.232358 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.232242 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 12:22:54.232358 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.232282 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 12:22:54.233502 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.233486 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 12:22:54.237663 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.237645 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn"] Jun 11 12:22:54.305873 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.305841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-tmp\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.306028 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.305891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sj9\" (UniqueName: \"kubernetes.io/projected/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-kube-api-access-k2sj9\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.306028 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.305918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.406268 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.406218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.406464 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.406300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-tmp\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.406464 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.406334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sj9\" (UniqueName: \"kubernetes.io/projected/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-kube-api-access-k2sj9\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.406693 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.406672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-tmp\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.408770 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.408747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.428253 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.428203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sj9\" (UniqueName: \"kubernetes.io/projected/42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0-kube-api-access-k2sj9\") pod \"klusterlet-addon-workmgr-6fd55888f8-bwbmn\" (UID: \"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.539276 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.539182 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:54.658183 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:54.658147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn"] Jun 11 12:22:54.661684 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:22:54.661655 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42bf36a2_6b2b_4b5a_a25d_65e5e25b87f0.slice/crio-f246968d53f32c86fb85ae4a8241e30400608cf8375eac7a9e3b7a94f2de4eae WatchSource:0}: Error finding container f246968d53f32c86fb85ae4a8241e30400608cf8375eac7a9e3b7a94f2de4eae: Status 404 returned error can't find the container with id f246968d53f32c86fb85ae4a8241e30400608cf8375eac7a9e3b7a94f2de4eae Jun 11 12:22:55.493571 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:55.493537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" event={"ID":"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0","Type":"ContainerStarted","Data":"f246968d53f32c86fb85ae4a8241e30400608cf8375eac7a9e3b7a94f2de4eae"} Jun 11 12:22:58.502545 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:58.502459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" event={"ID":"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0","Type":"ContainerStarted","Data":"d985dd5e801166c790a6ef01fbb0d6b744b9d15391a10ae7e577cbe09bc7d68e"} Jun 11 12:22:58.502915 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:58.502677 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:58.504173 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:58.504156 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:22:58.519005 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:22:58.518965 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" podStartSLOduration=0.998727895 podStartE2EDuration="4.518951564s" totalImagesPullingTime="3.520223669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:22:58.517444284 +0000 UTC m=+125.815820806" watchObservedRunningTime="2026-06-11 12:22:58.518951564 +0000 UTC m=+125.817328065" Jun 11 12:23:02.969258 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:02.969200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:23:02.969642 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:02.969350 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:23:02.969642 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:02.969414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs podName:454ea5ce-abc2-4341-a088-5d29e59ed4aa nodeName:}" failed. No retries permitted until 2026-06-11 12:25:04.969397802 +0000 UTC m=+252.267774289 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs") pod "network-metrics-daemon-bcskh" (UID: "454ea5ce-abc2-4341-a088-5d29e59ed4aa") : secret "metrics-daemon-secret" not found Jun 11 12:23:32.056473 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:32.056432 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77c754656-2j74s" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" Jun 11 12:23:32.066575 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:32.066542 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xpf2j" podUID="749d36cc-42b9-45e5-8142-b45dcb27f05f" Jun 11 12:23:32.582585 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:32.582557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:23:32.582769 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:32.582557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:23:33.096385 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:33.096352 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bcskh" podUID="454ea5ce-abc2-4341-a088-5d29e59ed4aa" Jun 11 12:23:37.009036 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:37.008992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:23:37.009036 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:37.009048 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:23:37.009507 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:37.009135 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:23:37.009507 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:37.009147 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c754656-2j74s: secret "image-registry-tls" not found Jun 11 12:23:37.009507 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:37.009196 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls podName:b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd nodeName:}" failed. No retries permitted until 2026-06-11 12:25:39.009182747 +0000 UTC m=+286.307559227 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls") pod "image-registry-77c754656-2j74s" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd") : secret "image-registry-tls" not found Jun 11 12:23:37.009507 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:37.009135 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:23:37.009507 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:23:37.009267 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls podName:749d36cc-42b9-45e5-8142-b45dcb27f05f nodeName:}" failed. No retries permitted until 2026-06-11 12:25:39.009252401 +0000 UTC m=+286.307628882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls") pod "dns-default-xpf2j" (UID: "749d36cc-42b9-45e5-8142-b45dcb27f05f") : secret "dns-default-metrics-tls" not found Jun 11 12:23:45.083347 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:23:45.083257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:24:13.406791 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.406757 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4"] Jun 11 12:24:13.409638 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.409618 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh"] Jun 11 12:24:13.409761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.409727 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.412428 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.412408 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.458799 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.458774 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4"] Jun 11 12:24:13.461759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.461733 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 12:24:13.461880 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.461807 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 12:24:13.462012 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.461963 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.462074 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.462019 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 12:24:13.462074 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.462027 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.462180 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.462074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 12:24:13.462306 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.462289 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-drqwm\"" Jun 11 12:24:13.462375 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.462306 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-92xlc\"" Jun 11 12:24:13.470415 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.470391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.470542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.470425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.470542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.470487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.470542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.470511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5djpb\" (UniqueName: \"kubernetes.io/projected/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-kube-api-access-5djpb\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.470712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.470549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-config\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.492288 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.492265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh"] Jun 11 12:24:13.526251 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.526202 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-r77sk"] Jun 11 12:24:13.529284 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.529267 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.534459 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.534436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p2qrp\"" Jun 11 12:24:13.534594 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.534440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 12:24:13.538818 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.538795 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.539005 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.538987 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 12:24:13.539060 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.539046 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.550005 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.549984 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m"] Jun 11 12:24:13.551530 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.551516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 12:24:13.552750 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.552737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.556988 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.556970 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 12:24:13.556988 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.556975 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.558189 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.558170 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9xkr\"" Jun 11 12:24:13.558441 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.558423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.559617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.559531 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 12:24:13.563569 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.563548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r77sk"] Jun 11 12:24:13.564469 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.564449 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9"] Jun 11 12:24:13.567425 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.567398 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.571030 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-trusted-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.571118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5djpb\" (UniqueName: \"kubernetes.io/projected/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-kube-api-access-5djpb\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.571118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.571118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571097 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.571349 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-config\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.571349 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.571164 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:13.571349 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.571244 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.071226928 +0000 UTC m=+201.369603424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:13.571349 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41c26904-9ef4-4837-8610-5b700bdf2ae3-serving-cert\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571349 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.571567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-snapshots\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-service-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hdm\" (UniqueName: \"kubernetes.io/projected/41c26904-9ef4-4837-8610-5b700bdf2ae3-kube-api-access-22hdm\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-tmp\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.571798 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 12:24:13.571798 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571724 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-config\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.571798 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:13.571947 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.571813 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 12:24:13.572188 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.572170 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.572787 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.572770 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vvlvn\"" Jun 11 12:24:13.573667 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.573645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.599909 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.599885 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9"] Jun 11 12:24:13.600846 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.600822 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m"] Jun 11 12:24:13.601600 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.601576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5djpb\" (UniqueName: \"kubernetes.io/projected/253d2f4a-dae8-4c5f-83b8-7cc9a6175492-kube-api-access-5djpb\") pod \"service-ca-operator-6bc5ff68f5-gdfbh\" (UID: \"253d2f4a-dae8-4c5f-83b8-7cc9a6175492\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.630576 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.630552 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst"] Jun 11 12:24:13.635272 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.635250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.637951 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.637934 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 12:24:13.638118 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.638095 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:24:13.638179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.638106 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-65zw7\"" Jun 11 12:24:13.638303 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.638288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 12:24:13.650291 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.650270 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst"] Jun 11 12:24:13.672338 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.672338 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-trusted-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672338 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7hkt\" (UniqueName: \"kubernetes.io/projected/e94a81c8-ba5a-46f6-9846-9011c61784b2-kube-api-access-v7hkt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e94a81c8-ba5a-46f6-9846-9011c61784b2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8pg\" (UniqueName: \"kubernetes.io/projected/4b018ed3-e104-4973-b6ea-f564dc0ea453-kube-api-access-tp8pg\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e94a81c8-ba5a-46f6-9846-9011c61784b2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41c26904-9ef4-4837-8610-5b700bdf2ae3-serving-cert\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.672555 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-snapshots\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-service-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hdm\" (UniqueName: \"kubernetes.io/projected/41c26904-9ef4-4837-8610-5b700bdf2ae3-kube-api-access-22hdm\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-tmp\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.672863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4b018ed3-e104-4973-b6ea-f564dc0ea453-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.672863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.672734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87s5x\" (UniqueName: \"kubernetes.io/projected/50d4be03-d49b-41a6-bb7c-3cd906b289ed-kube-api-access-87s5x\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.673119 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.673098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-tmp\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.673179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.673141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-service-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.673179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.673153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41c26904-9ef4-4837-8610-5b700bdf2ae3-snapshots\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.673399 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.673380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c26904-9ef4-4837-8610-5b700bdf2ae3-trusted-ca-bundle\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.674984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.674969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41c26904-9ef4-4837-8610-5b700bdf2ae3-serving-cert\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.685835 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.685808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hdm\" (UniqueName: \"kubernetes.io/projected/41c26904-9ef4-4837-8610-5b700bdf2ae3-kube-api-access-22hdm\") pod \"insights-operator-896549976-r77sk\" (UID: \"41c26904-9ef4-4837-8610-5b700bdf2ae3\") " pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.723179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.723151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" Jun 11 12:24:13.773924 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.773895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4b018ed3-e104-4973-b6ea-f564dc0ea453-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.774072 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.773928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87s5x\" (UniqueName: \"kubernetes.io/projected/50d4be03-d49b-41a6-bb7c-3cd906b289ed-kube-api-access-87s5x\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.774072 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.773955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.774072 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.773987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7hkt\" (UniqueName: \"kubernetes.io/projected/e94a81c8-ba5a-46f6-9846-9011c61784b2-kube-api-access-v7hkt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.774243 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.774092 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:13.774243 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e94a81c8-ba5a-46f6-9846-9011c61784b2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.774243 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.774177 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.274156447 +0000 UTC m=+201.572532932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:13.774402 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8pg\" (UniqueName: \"kubernetes.io/projected/4b018ed3-e104-4973-b6ea-f564dc0ea453-kube-api-access-tp8pg\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.774402 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e94a81c8-ba5a-46f6-9846-9011c61784b2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.774499 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.774566 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.774552 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 12:24:13.774613 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:13.774606 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls podName:50d4be03-d49b-41a6-bb7c-3cd906b289ed nodeName:}" failed. No retries permitted until 2026-06-11 12:24:14.27459137 +0000 UTC m=+201.572967857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-8qxst" (UID: "50d4be03-d49b-41a6-bb7c-3cd906b289ed") : secret "samples-operator-tls" not found Jun 11 12:24:13.774831 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4b018ed3-e104-4973-b6ea-f564dc0ea453-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.774898 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.774863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e94a81c8-ba5a-46f6-9846-9011c61784b2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.776350 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.776326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e94a81c8-ba5a-46f6-9846-9011c61784b2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.783980 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.783930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7hkt\" (UniqueName: \"kubernetes.io/projected/e94a81c8-ba5a-46f6-9846-9011c61784b2-kube-api-access-v7hkt\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pjss9\" (UID: \"e94a81c8-ba5a-46f6-9846-9011c61784b2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.785045 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.785019 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8pg\" (UniqueName: \"kubernetes.io/projected/4b018ed3-e104-4973-b6ea-f564dc0ea453-kube-api-access-tp8pg\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:13.786248 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.786230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87s5x\" (UniqueName: \"kubernetes.io/projected/50d4be03-d49b-41a6-bb7c-3cd906b289ed-kube-api-access-87s5x\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:13.838598 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.838567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r77sk" Jun 11 12:24:13.844432 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.844412 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh"] Jun 11 12:24:13.848861 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:13.848834 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253d2f4a_dae8_4c5f_83b8_7cc9a6175492.slice/crio-82fa941f6c7da74dc1d011537691bda12b711c3254b35155b605f9a73d5df745 WatchSource:0}: Error finding container 82fa941f6c7da74dc1d011537691bda12b711c3254b35155b605f9a73d5df745: Status 404 returned error can't find the container with id 82fa941f6c7da74dc1d011537691bda12b711c3254b35155b605f9a73d5df745 Jun 11 12:24:13.880755 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.880729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" Jun 11 12:24:13.980931 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:13.980897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r77sk"] Jun 11 12:24:13.983918 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:13.983891 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c26904_9ef4_4837_8610_5b700bdf2ae3.slice/crio-cc7566a0e13d3c571f3aa317cfe3b52db6d4b844a91958897e8eb2111c726cc5 WatchSource:0}: Error finding container cc7566a0e13d3c571f3aa317cfe3b52db6d4b844a91958897e8eb2111c726cc5: Status 404 returned error can't find the container with id cc7566a0e13d3c571f3aa317cfe3b52db6d4b844a91958897e8eb2111c726cc5 Jun 11 12:24:14.010110 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.010080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9"] Jun 11 12:24:14.012787 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:14.012756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94a81c8_ba5a_46f6_9846_9011c61784b2.slice/crio-dff4353f9cb0b2ac018559e6f69aa1e2e1051439a113540ea6a69f7705475f83 WatchSource:0}: Error finding container dff4353f9cb0b2ac018559e6f69aa1e2e1051439a113540ea6a69f7705475f83: Status 404 returned error can't find the container with id dff4353f9cb0b2ac018559e6f69aa1e2e1051439a113540ea6a69f7705475f83 Jun 11 12:24:14.076355 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.076324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:14.076503 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.076464 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:14.076550 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.076524 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.076509855 +0000 UTC m=+202.374886335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:14.278067 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.277984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:14.278238 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.278132 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:14.278238 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.278144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:14.278238 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.278189 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.278174961 +0000 UTC m=+202.576551444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:14.278359 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.278268 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 12:24:14.278359 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:14.278315 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls podName:50d4be03-d49b-41a6-bb7c-3cd906b289ed nodeName:}" failed. No retries permitted until 2026-06-11 12:24:15.278300958 +0000 UTC m=+202.576677438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-8qxst" (UID: "50d4be03-d49b-41a6-bb7c-3cd906b289ed") : secret "samples-operator-tls" not found Jun 11 12:24:14.683636 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.683594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" event={"ID":"253d2f4a-dae8-4c5f-83b8-7cc9a6175492","Type":"ContainerStarted","Data":"82fa941f6c7da74dc1d011537691bda12b711c3254b35155b605f9a73d5df745"} Jun 11 12:24:14.685356 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.685322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" event={"ID":"e94a81c8-ba5a-46f6-9846-9011c61784b2","Type":"ContainerStarted","Data":"dff4353f9cb0b2ac018559e6f69aa1e2e1051439a113540ea6a69f7705475f83"} Jun 11 12:24:14.686854 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:14.686823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r77sk" event={"ID":"41c26904-9ef4-4837-8610-5b700bdf2ae3","Type":"ContainerStarted","Data":"cc7566a0e13d3c571f3aa317cfe3b52db6d4b844a91958897e8eb2111c726cc5"} Jun 11 12:24:15.084120 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:15.084041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:15.084310 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.084162 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:15.084310 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.084231 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.084201139 +0000 UTC m=+204.382577620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:15.285852 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:15.285816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:15.286033 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.285961 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 12:24:15.286081 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.286037 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls podName:50d4be03-d49b-41a6-bb7c-3cd906b289ed nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.286019615 +0000 UTC m=+204.584396095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-8qxst" (UID: "50d4be03-d49b-41a6-bb7c-3cd906b289ed") : secret "samples-operator-tls" not found Jun 11 12:24:15.286140 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:15.286073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:15.286265 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.286248 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:15.286334 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:15.286299 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:17.286285872 +0000 UTC m=+204.584662352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:17.100625 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.100551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:17.101049 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.100719 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:17.101049 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.100802 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.100772674 +0000 UTC m=+208.399149168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:17.302497 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.302458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:17.302691 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.302548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:17.302691 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.302641 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:17.302691 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.302678 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 12:24:17.302838 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.302722 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.302701643 +0000 UTC m=+208.601078137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:17.302838 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:17.302742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls podName:50d4be03-d49b-41a6-bb7c-3cd906b289ed nodeName:}" failed. No retries permitted until 2026-06-11 12:24:21.30273207 +0000 UTC m=+208.601108556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-8qxst" (UID: "50d4be03-d49b-41a6-bb7c-3cd906b289ed") : secret "samples-operator-tls" not found Jun 11 12:24:17.699451 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.699367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" event={"ID":"253d2f4a-dae8-4c5f-83b8-7cc9a6175492","Type":"ContainerStarted","Data":"1c647509034f68fe729fd72d6bbea994591fe37e969160fb682836f847f42d5a"} Jun 11 12:24:17.701033 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.700998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" event={"ID":"e94a81c8-ba5a-46f6-9846-9011c61784b2","Type":"ContainerStarted","Data":"3ef4e1c70841a0c8e37ab075c945d4966ad81d6b9bd859d9051a67bce718a1ad"} Jun 11 12:24:17.702548 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.702522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r77sk" event={"ID":"41c26904-9ef4-4837-8610-5b700bdf2ae3","Type":"ContainerStarted","Data":"ba4671771b58d1ce333b0e827aa1ae15c646d84fe3af6c79a85315e2fc9b97b8"} Jun 11 12:24:17.783301 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.783241 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" podStartSLOduration=1.7624622749999999 podStartE2EDuration="4.783197969s" totalImagesPullingTime="3.020735694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:17.734152197 +0000 UTC m=+205.032528720" watchObservedRunningTime="2026-06-11 12:24:17.783197969 +0000 UTC m=+205.081574472" Jun 11 12:24:17.783455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.783348 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-r77sk" podStartSLOduration=1.891472143 podStartE2EDuration="4.783339516s" totalImagesPullingTime="2.891867373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:17.78185948 +0000 UTC m=+205.080235983" watchObservedRunningTime="2026-06-11 12:24:17.783339516 +0000 UTC m=+205.081716020" Jun 11 12:24:17.830883 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:17.830827 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" podStartSLOduration=1.969792309 podStartE2EDuration="4.830812114s" totalImagesPullingTime="2.861019805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:17.830599085 +0000 UTC m=+205.128975585" watchObservedRunningTime="2026-06-11 12:24:17.830812114 +0000 UTC m=+205.129188615" Jun 11 12:24:20.863339 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:20.863312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69zsg_76f11c9b-915f-42d5-af54-b5b63509c584/dns-node-resolver/0.log" Jun 11 12:24:21.136324 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:21.136300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:21.136476 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.136452 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:21.136550 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.136538 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.13651137 +0000 UTC m=+216.434887865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:21.337785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:21.337733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:21.337965 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:21.337834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:21.337965 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.337900 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 12:24:21.338082 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.337980 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:21.338082 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.337983 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls podName:50d4be03-d49b-41a6-bb7c-3cd906b289ed nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.337966508 +0000 UTC m=+216.636342988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-8qxst" (UID: "50d4be03-d49b-41a6-bb7c-3cd906b289ed") : secret "samples-operator-tls" not found Jun 11 12:24:21.338082 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:21.338042 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:29.33802792 +0000 UTC m=+216.636404403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:21.862514 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:21.862487 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9d72r_d7feef61-f359-47fb-bcde-6fb39769cf6a/node-ca/0.log" Jun 11 12:24:22.658659 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:22.658627 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59252_8c1a4ff3-4173-40a4-a0e5-162d7df22396/serve-healthcheck-canary/0.log" Jun 11 12:24:23.665371 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:23.665343 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pjss9_e94a81c8-ba5a-46f6-9846-9011c61784b2/kube-storage-version-migrator-operator/0.log" Jun 11 12:24:29.198711 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.198671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:29.199107 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:29.198808 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 12:24:29.199107 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:29.198881 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert podName:7d5164ae-085d-47cc-b0c5-0eecb75d5cbb nodeName:}" failed. No retries permitted until 2026-06-11 12:24:45.19886487 +0000 UTC m=+232.497241355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c5xz4" (UID: "7d5164ae-085d-47cc-b0c5-0eecb75d5cbb") : secret "networking-console-plugin-cert" not found Jun 11 12:24:29.400671 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.400639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:29.400827 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.400710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:29.400827 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:29.400821 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:29.400920 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:29.400880 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls podName:4b018ed3-e104-4973-b6ea-f564dc0ea453 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:45.400867209 +0000 UTC m=+232.699243690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-knv7m" (UID: "4b018ed3-e104-4973-b6ea-f564dc0ea453") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:24:29.403027 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.402998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/50d4be03-d49b-41a6-bb7c-3cd906b289ed-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-8qxst\" (UID: \"50d4be03-d49b-41a6-bb7c-3cd906b289ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:29.544903 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.544813 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" Jun 11 12:24:29.669542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.669508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst"] Jun 11 12:24:29.740083 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:29.740055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" event={"ID":"50d4be03-d49b-41a6-bb7c-3cd906b289ed","Type":"ContainerStarted","Data":"a7d330ae60b0b746b3c0ae16167d0d0c046feeb11baa99703c216a1394f2bf78"} Jun 11 12:24:31.747087 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:31.747009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" event={"ID":"50d4be03-d49b-41a6-bb7c-3cd906b289ed","Type":"ContainerStarted","Data":"02022072b94cc7b960ca4ce5124cb766bcec78bf97ceb898c64d15bcd3f66617"} Jun 11 12:24:31.747087 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:31.747067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" event={"ID":"50d4be03-d49b-41a6-bb7c-3cd906b289ed","Type":"ContainerStarted","Data":"6d9b1d64b8764ecb675f7a51fbd3988830a207222ef328047f6babcef2079081"} Jun 11 12:24:31.767829 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:31.767788 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-8qxst" podStartSLOduration=17.077103469 podStartE2EDuration="18.767773295s" totalImagesPullingTime="1.690669826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:31.76749916 +0000 UTC m=+219.065875662" watchObservedRunningTime="2026-06-11 12:24:31.767773295 +0000 UTC m=+219.066149797" Jun 11 12:24:45.228570 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.228519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:45.230867 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.230845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d5164ae-085d-47cc-b0c5-0eecb75d5cbb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c5xz4\" (UID: \"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:45.430227 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.430156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:45.432591 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.432566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b018ed3-e104-4973-b6ea-f564dc0ea453-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-knv7m\" (UID: \"4b018ed3-e104-4973-b6ea-f564dc0ea453\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:45.518578 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.518497 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" Jun 11 12:24:45.643277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.643246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4"] Jun 11 12:24:45.646092 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:45.646064 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5164ae_085d_47cc_b0c5_0eecb75d5cbb.slice/crio-7216d37bf451d428a6b82260d823400298f23d9ade335ed0b4971aa26cf7db00 WatchSource:0}: Error finding container 7216d37bf451d428a6b82260d823400298f23d9ade335ed0b4971aa26cf7db00: Status 404 returned error can't find the container with id 7216d37bf451d428a6b82260d823400298f23d9ade335ed0b4971aa26cf7db00 Jun 11 12:24:45.662548 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.662529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" Jun 11 12:24:45.785709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.785686 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m"] Jun 11 12:24:45.787781 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:45.787756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b018ed3_e104_4973_b6ea_f564dc0ea453.slice/crio-c02ae5c3759142a9de94aaa2db376b831df81f84a8c2d0694e91625d908bddb0 WatchSource:0}: Error finding container c02ae5c3759142a9de94aaa2db376b831df81f84a8c2d0694e91625d908bddb0: Status 404 returned error can't find the container with id c02ae5c3759142a9de94aaa2db376b831df81f84a8c2d0694e91625d908bddb0 Jun 11 12:24:45.790882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:45.790850 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" event={"ID":"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb","Type":"ContainerStarted","Data":"7216d37bf451d428a6b82260d823400298f23d9ade335ed0b4971aa26cf7db00"} Jun 11 12:24:46.794547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:46.794511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" event={"ID":"4b018ed3-e104-4973-b6ea-f564dc0ea453","Type":"ContainerStarted","Data":"c02ae5c3759142a9de94aaa2db376b831df81f84a8c2d0694e91625d908bddb0"} Jun 11 12:24:47.799290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:47.799254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" event={"ID":"7d5164ae-085d-47cc-b0c5-0eecb75d5cbb","Type":"ContainerStarted","Data":"37efc6c829ec25e1b444b9cc2e382155bdb5c7c05f5b988994f8e18a22a325b4"} Jun 11 12:24:47.820619 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:47.820574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c5xz4" podStartSLOduration=33.626545543 podStartE2EDuration="34.82055635s" totalImagesPullingTime="1.194010807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:47.819364421 +0000 UTC m=+235.117740923" watchObservedRunningTime="2026-06-11 12:24:47.82055635 +0000 UTC m=+235.118932853" Jun 11 12:24:52.815546 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:52.815505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" event={"ID":"4b018ed3-e104-4973-b6ea-f564dc0ea453","Type":"ContainerStarted","Data":"cba799c9e77915e775cb7d54815b9e3a5d9107f535ee8a97c010ecdf1f70885c"} Jun 11 12:24:52.834618 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:52.834567 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-knv7m" podStartSLOduration=32.967052928 podStartE2EDuration="39.834552183s" totalImagesPullingTime="6.867499255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:24:52.833545508 +0000 UTC m=+240.131922010" watchObservedRunningTime="2026-06-11 12:24:52.834552183 +0000 UTC m=+240.132928686" Jun 11 12:24:58.303611 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.303583 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:24:58.306576 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.306555 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.312069 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.312042 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-serving-cert\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" Jun 11 12:24:58.312553 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.312524 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" Jun 11 12:24:58.312662 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.312566 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-dockercfg-9glsz\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-dockercfg-9glsz\"" type="*v1.Secret" Jun 11 12:24:58.312662 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.312628 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-oauth-config\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" Jun 11 12:24:58.313401 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.313376 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-config\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" Jun 11 12:24:58.313677 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.313657 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" Jun 11 12:24:58.313724 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.313705 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" Jun 11 12:24:58.314395 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.314372 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-6d98c5557c-hdzjc\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="4693f5d1-372e-4490-972f-c79a898efc92" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.314684 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:58.314667 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 11 12:24:58.320328 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.320310 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 12:24:58.323617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323819 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323819 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323885 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.323885 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.323855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.357597 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.357570 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:24:58.424733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424945 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424945 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424945 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424945 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.424945 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.424894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:58.457703 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.457676 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np"] Jun 11 12:24:58.460767 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.460748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:24:58.464747 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.464730 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 12:24:58.465270 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.465253 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2cjzs\"" Jun 11 12:24:58.484687 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.484662 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-chrfj"] Jun 11 12:24:58.487569 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.487554 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np"] Jun 11 12:24:58.487639 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.487632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.490024 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.490006 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cg8m\"" Jun 11 12:24:58.490178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.490156 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 12:24:58.490178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.490170 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 12:24:58.503154 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.503124 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" podUID="42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 11 12:24:58.511141 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.511115 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chrfj"] Jun 11 12:24:58.525707 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.525707 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-crio-socket\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.525847 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.525847 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4897df5-929b-43c6-a0c8-1de3a45a5c1a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gs8np\" (UID: \"b4897df5-929b-43c6-a0c8-1de3a45a5c1a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:24:58.525931 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-data-volume\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.525931 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.525867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52vkp\" (UniqueName: \"kubernetes.io/projected/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-api-access-52vkp\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.626419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.626374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.626611 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.626474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4897df5-929b-43c6-a0c8-1de3a45a5c1a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gs8np\" (UID: \"b4897df5-929b-43c6-a0c8-1de3a45a5c1a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:24:58.626611 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.626537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-data-volume\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.626859 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.626832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52vkp\" (UniqueName: \"kubernetes.io/projected/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-api-access-52vkp\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.627000 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.626892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.627061 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.627037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-crio-socket\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.627300 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.627231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-crio-socket\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.627300 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.627238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-data-volume\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.627454 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.627422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.631234 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.629908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b4897df5-929b-43c6-a0c8-1de3a45a5c1a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gs8np\" (UID: \"b4897df5-929b-43c6-a0c8-1de3a45a5c1a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:24:58.632774 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.632750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.642163 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.642139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52vkp\" (UniqueName: \"kubernetes.io/projected/1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a-kube-api-access-52vkp\") pod \"insights-runtime-extractor-chrfj\" (UID: \"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a\") " pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.769641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.769607 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:24:58.795995 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.795962 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-chrfj" Jun 11 12:24:58.838863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.838081 2559 generic.go:356] "Generic (PLEG): container finished" podID="42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0" containerID="d985dd5e801166c790a6ef01fbb0d6b744b9d15391a10ae7e577cbe09bc7d68e" exitCode=1 Jun 11 12:24:58.838863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.838181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" event={"ID":"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0","Type":"ContainerDied","Data":"d985dd5e801166c790a6ef01fbb0d6b744b9d15391a10ae7e577cbe09bc7d68e"} Jun 11 12:24:58.838863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.838627 2559 scope.go:117] "RemoveContainer" containerID="d985dd5e801166c790a6ef01fbb0d6b744b9d15391a10ae7e577cbe09bc7d68e" Jun 11 12:24:58.915468 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.915411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np"] Jun 11 12:24:58.918746 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:58.918716 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4897df5_929b_43c6_a0c8_1de3a45a5c1a.slice/crio-cb362157161c1dcacf0ec02f9bbd6084620a4195bab3c20ac5853ef622a5a6f0 WatchSource:0}: Error finding container cb362157161c1dcacf0ec02f9bbd6084620a4195bab3c20ac5853ef622a5a6f0: Status 404 returned error can't find the container with id cb362157161c1dcacf0ec02f9bbd6084620a4195bab3c20ac5853ef622a5a6f0 Jun 11 12:24:58.941516 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:58.941484 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-chrfj"] Jun 11 12:24:58.945074 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:24:58.945000 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd7c98b_c0a4_40ca_a95e_5b7d6810aa8a.slice/crio-1cf9194e090e391dee62a1319f65429b1c5ad414305f9c85a2880a21a01cab7e WatchSource:0}: Error finding container 1cf9194e090e391dee62a1319f65429b1c5ad414305f9c85a2880a21a01cab7e: Status 404 returned error can't find the container with id 1cf9194e090e391dee62a1319f65429b1c5ad414305f9c85a2880a21a01cab7e Jun 11 12:24:59.134547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.134518 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 12:24:59.136015 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.135995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.163535 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.163504 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9glsz\"" Jun 11 12:24:59.254273 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.254240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 12:24:59.257541 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.257518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.321551 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.321517 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 12:24:59.326390 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.326372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.426012 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.425930 2559 configmap.go:193] Couldn't get configMap openshift-console/console-config: failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.426012 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.426003 2559 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.426195 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.426018 2559 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: failed to sync secret cache: timed out waiting for the condition Jun 11 12:24:59.426195 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.426023 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config podName:4693f5d1-372e-4490-972f-c79a898efc92 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:59.926005474 +0000 UTC m=+247.224382015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config") pod "console-6d98c5557c-hdzjc" (UID: "4693f5d1-372e-4490-972f-c79a898efc92") : failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.426195 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.426072 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert podName:4693f5d1-372e-4490-972f-c79a898efc92 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:59.926056716 +0000 UTC m=+247.224433199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert") pod "console-6d98c5557c-hdzjc" (UID: "4693f5d1-372e-4490-972f-c79a898efc92") : failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.426195 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.426083 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config podName:4693f5d1-372e-4490-972f-c79a898efc92 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:59.926077165 +0000 UTC m=+247.224453645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config") pod "console-6d98c5557c-hdzjc" (UID: "4693f5d1-372e-4490-972f-c79a898efc92") : failed to sync secret cache: timed out waiting for the condition Jun 11 12:24:59.464283 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.464243 2559 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.464474 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.464295 2559 projected.go:196] Error preparing data for projected volume kube-api-access-rppxs for pod openshift-console/console-6d98c5557c-hdzjc: failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.464474 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:24:59.464365 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs podName:4693f5d1-372e-4490-972f-c79a898efc92 nodeName:}" failed. No retries permitted until 2026-06-11 12:24:59.96434662 +0000 UTC m=+247.262723115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rppxs" (UniqueName: "kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs") pod "console-6d98c5557c-hdzjc" (UID: "4693f5d1-372e-4490-972f-c79a898efc92") : failed to sync configmap cache: timed out waiting for the condition Jun 11 12:24:59.485658 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.485629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 12:24:59.670635 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.670596 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 12:24:59.692333 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.692245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 12:24:59.800032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.800000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 12:24:59.844492 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.844453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chrfj" event={"ID":"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a","Type":"ContainerStarted","Data":"0a881f3043801005915f7522fea2063b863c60289fdc753db2bb72145978396f"} Jun 11 12:24:59.844640 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.844514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chrfj" event={"ID":"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a","Type":"ContainerStarted","Data":"b876ffe0bbde65a8a2f07640907fe49081c65aa531f008f065cac33cdda906b8"} Jun 11 12:24:59.844640 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.844542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chrfj" event={"ID":"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a","Type":"ContainerStarted","Data":"1cf9194e090e391dee62a1319f65429b1c5ad414305f9c85a2880a21a01cab7e"} Jun 11 12:24:59.847973 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.847942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" event={"ID":"b4897df5-929b-43c6-a0c8-1de3a45a5c1a","Type":"ContainerStarted","Data":"cb362157161c1dcacf0ec02f9bbd6084620a4195bab3c20ac5853ef622a5a6f0"} Jun 11 12:24:59.849879 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.849858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" event={"ID":"42bf36a2-6b2b-4b5a-a25d-65e5e25b87f0","Type":"ContainerStarted","Data":"2790208e60d91a0408781a63abb7212668e926db08dbdb2942d9a812ab6bfadf"} Jun 11 12:24:59.850134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.850117 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:24:59.850854 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.850837 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fd55888f8-bwbmn" Jun 11 12:24:59.938148 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.938109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.938356 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.938172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.938356 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.938300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.938809 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.938781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.938963 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.938936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:24:59.941155 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:24:59.941133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:00.039774 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.039691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:00.042534 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.042510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") pod \"console-6d98c5557c-hdzjc\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:00.146743 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.146717 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:00.317847 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.317755 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:25:00.321055 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:00.321030 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4693f5d1_372e_4490_972f_c79a898efc92.slice/crio-d90d96eaebb083146eda8f9eda315e422352366095d33671f6f4f419aaa6c9d6 WatchSource:0}: Error finding container d90d96eaebb083146eda8f9eda315e422352366095d33671f6f4f419aaa6c9d6: Status 404 returned error can't find the container with id d90d96eaebb083146eda8f9eda315e422352366095d33671f6f4f419aaa6c9d6 Jun 11 12:25:00.855924 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.855888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" event={"ID":"b4897df5-929b-43c6-a0c8-1de3a45a5c1a","Type":"ContainerStarted","Data":"4aab52440744a5a33879cbccca63a86e077c8efc0c5d01a0a4c6d090fc1cb072"} Jun 11 12:25:00.856535 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.856093 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:25:00.857530 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.857494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98c5557c-hdzjc" event={"ID":"4693f5d1-372e-4490-972f-c79a898efc92","Type":"ContainerStarted","Data":"d90d96eaebb083146eda8f9eda315e422352366095d33671f6f4f419aaa6c9d6"} Jun 11 12:25:00.862091 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.862065 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" Jun 11 12:25:00.873515 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:00.873471 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gs8np" podStartSLOduration=1.671160994 podStartE2EDuration="2.873458696s" totalImagesPullingTime="1.202297702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:00.873388477 +0000 UTC m=+248.171764981" watchObservedRunningTime="2026-06-11 12:25:00.873458696 +0000 UTC m=+248.171835199" Jun 11 12:25:01.863720 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:01.863685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-chrfj" event={"ID":"1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a","Type":"ContainerStarted","Data":"ea024ffd9c5d56a6efd0a81eb1cb30a72e48a1ace726b01e1864486b54fd40a3"} Jun 11 12:25:01.888356 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:01.888309 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-chrfj" podStartSLOduration=1.82154532 podStartE2EDuration="3.888293452s" totalImagesPullingTime="2.066748132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:24:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:01.888197628 +0000 UTC m=+249.186574131" watchObservedRunningTime="2026-06-11 12:25:01.888293452 +0000 UTC m=+249.186669957" Jun 11 12:25:03.872052 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:03.872015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98c5557c-hdzjc" event={"ID":"4693f5d1-372e-4490-972f-c79a898efc92","Type":"ContainerStarted","Data":"008bf6403e819d0bd7702dcce4aefe7b189a28ba7bcb3e4fc446cb68f5d096fa"} Jun 11 12:25:03.893565 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:03.893521 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d98c5557c-hdzjc" podStartSLOduration=2.473267572 podStartE2EDuration="5.893506674s" totalImagesPullingTime="3.420239102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:03.892601869 +0000 UTC m=+251.190978381" watchObservedRunningTime="2026-06-11 12:25:03.893506674 +0000 UTC m=+251.191883176" Jun 11 12:25:04.981248 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:04.981178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:25:04.983636 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:04.983606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/454ea5ce-abc2-4341-a088-5d29e59ed4aa-metrics-certs\") pod \"network-metrics-daemon-bcskh\" (UID: \"454ea5ce-abc2-4341-a088-5d29e59ed4aa\") " pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:25:05.186370 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.186340 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v492\"" Jun 11 12:25:05.194497 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.194469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcskh" Jun 11 12:25:05.323824 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.323790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcskh"] Jun 11 12:25:05.326805 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:05.326776 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454ea5ce_abc2_4341_a088_5d29e59ed4aa.slice/crio-3831147aa1c56eb2f1767296c883ae277c7e4a3feded2bbeafea996b0c52a58e WatchSource:0}: Error finding container 3831147aa1c56eb2f1767296c883ae277c7e4a3feded2bbeafea996b0c52a58e: Status 404 returned error can't find the container with id 3831147aa1c56eb2f1767296c883ae277c7e4a3feded2bbeafea996b0c52a58e Jun 11 12:25:05.816199 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.816168 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-djfbc"] Jun 11 12:25:05.818616 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.818596 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.822434 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.822411 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 12:25:05.822612 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.822592 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 12:25:05.823264 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.823244 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 12:25:05.823698 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.823680 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8nktv\"" Jun 11 12:25:05.823920 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.823901 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 12:25:05.880075 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.880034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcskh" event={"ID":"454ea5ce-abc2-4341-a088-5d29e59ed4aa","Type":"ContainerStarted","Data":"3831147aa1c56eb2f1767296c883ae277c7e4a3feded2bbeafea996b0c52a58e"} Jun 11 12:25:05.889562 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7swm\" (UniqueName: \"kubernetes.io/projected/cecacd08-440e-4d5f-a7de-d497883320dd-kube-api-access-m7swm\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-wtmp\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-root\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-metrics-client-ca\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-sys\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-textfile\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.889882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.890051 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.889887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-tls\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.990683 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-metrics-client-ca\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-sys\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-textfile\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-tls\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7swm\" (UniqueName: \"kubernetes.io/projected/cecacd08-440e-4d5f-a7de-d497883320dd-kube-api-access-m7swm\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-sys\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-wtmp\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.990962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-root\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.991031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-root\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991669 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.991144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-wtmp\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991669 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.991266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-textfile\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991669 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.991443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-metrics-client-ca\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.991669 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.991545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.993240 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.993201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:05.993814 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:05.993789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cecacd08-440e-4d5f-a7de-d497883320dd-node-exporter-tls\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:06.005860 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.005838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7swm\" (UniqueName: \"kubernetes.io/projected/cecacd08-440e-4d5f-a7de-d497883320dd-kube-api-access-m7swm\") pod \"node-exporter-djfbc\" (UID: \"cecacd08-440e-4d5f-a7de-d497883320dd\") " pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:06.131097 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.131007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djfbc" Jun 11 12:25:06.154923 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:06.154895 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecacd08_440e_4d5f_a7de_d497883320dd.slice/crio-1df282350e17ec722f784c3edb58fa55971204d6e42c9f01c91bc9b138de3ab5 WatchSource:0}: Error finding container 1df282350e17ec722f784c3edb58fa55971204d6e42c9f01c91bc9b138de3ab5: Status 404 returned error can't find the container with id 1df282350e17ec722f784c3edb58fa55971204d6e42c9f01c91bc9b138de3ab5 Jun 11 12:25:06.888262 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.888228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djfbc" event={"ID":"cecacd08-440e-4d5f-a7de-d497883320dd","Type":"ContainerStarted","Data":"1df282350e17ec722f784c3edb58fa55971204d6e42c9f01c91bc9b138de3ab5"} Jun 11 12:25:06.890143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.890120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcskh" event={"ID":"454ea5ce-abc2-4341-a088-5d29e59ed4aa","Type":"ContainerStarted","Data":"3aeae825b3edf15907d5434642bf2fe757f6edd1fb2518ef2d32b3d7385c4bb9"} Jun 11 12:25:06.890299 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.890162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcskh" event={"ID":"454ea5ce-abc2-4341-a088-5d29e59ed4aa","Type":"ContainerStarted","Data":"d1b119237ca56a3fe01ebadba6ba4ce2cf0928abd5d025ad7c75918c1748c241"} Jun 11 12:25:06.910940 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:06.910893 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bcskh" podStartSLOduration=253.063787559 podStartE2EDuration="4m13.91087749s" totalImagesPullingTime="847.089931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:06.90900488 +0000 UTC m=+254.207381387" watchObservedRunningTime="2026-06-11 12:25:06.91087749 +0000 UTC m=+254.209253991" Jun 11 12:25:07.895831 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:07.895800 2559 generic.go:356] "Generic (PLEG): container finished" podID="cecacd08-440e-4d5f-a7de-d497883320dd" containerID="c349144c84e63915d3a023022bc273cd2981086f3ba42b11df9c348c55925f05" exitCode=0 Jun 11 12:25:07.896233 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:07.895894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djfbc" event={"ID":"cecacd08-440e-4d5f-a7de-d497883320dd","Type":"ContainerDied","Data":"c349144c84e63915d3a023022bc273cd2981086f3ba42b11df9c348c55925f05"} Jun 11 12:25:08.901099 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:08.901069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djfbc" event={"ID":"cecacd08-440e-4d5f-a7de-d497883320dd","Type":"ContainerStarted","Data":"4dfd40eb8726b0c9945fbefd0307504256727bdaac883389905ddf74f05baa34"} Jun 11 12:25:08.901475 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:08.901120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djfbc" event={"ID":"cecacd08-440e-4d5f-a7de-d497883320dd","Type":"ContainerStarted","Data":"1606d37e34250862beb3c98090a2cf79e120809889246ed3e43354612fa1a9db"} Jun 11 12:25:08.922976 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:08.922924 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-djfbc" podStartSLOduration=2.910128346 podStartE2EDuration="3.922908974s" totalImagesPullingTime="949.063154ms" totalInitContainerRuntime="63.717474ms" isStatefulPod=true podCreationTimestamp="2026-06-11 12:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:08.921092024 +0000 UTC m=+256.219468528" watchObservedRunningTime="2026-06-11 12:25:08.922908974 +0000 UTC m=+256.221285475" Jun 11 12:25:10.146879 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.146850 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:10.147259 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.146905 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:10.148198 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.148175 2559 patch_prober.go:28] interesting pod/console-6d98c5557c-hdzjc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jun 11 12:25:10.148309 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.148230 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6d98c5557c-hdzjc" podUID="4693f5d1-372e-4490-972f-c79a898efc92" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jun 11 12:25:10.428913 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.428836 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf"] Jun 11 12:25:10.431894 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.431879 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.434423 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.434386 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 12:25:10.434608 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.434588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-db4bm\"" Jun 11 12:25:10.450150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.450125 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf"] Jun 11 12:25:10.530595 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.530560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swkmw\" (UniqueName: \"kubernetes.io/projected/09d1d311-3a5b-4626-8c97-7c73739e08ed-kube-api-access-swkmw\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.530744 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.530606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d1d311-3a5b-4626-8c97-7c73739e08ed-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.632022 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.631987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swkmw\" (UniqueName: \"kubernetes.io/projected/09d1d311-3a5b-4626-8c97-7c73739e08ed-kube-api-access-swkmw\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.632232 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.632031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d1d311-3a5b-4626-8c97-7c73739e08ed-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.634460 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.634439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09d1d311-3a5b-4626-8c97-7c73739e08ed-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.641521 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.641486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swkmw\" (UniqueName: \"kubernetes.io/projected/09d1d311-3a5b-4626-8c97-7c73739e08ed-kube-api-access-swkmw\") pod \"monitoring-plugin-76b68cc874-sdvdf\" (UID: \"09d1d311-3a5b-4626-8c97-7c73739e08ed\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.740540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.740460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:10.863264 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.863181 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf"] Jun 11 12:25:10.865996 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:10.865973 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d1d311_3a5b_4626_8c97_7c73739e08ed.slice/crio-1e013f19f269cc19068c1b8942790dcdfeb18f1151772907ddedc755b882574b WatchSource:0}: Error finding container 1e013f19f269cc19068c1b8942790dcdfeb18f1151772907ddedc755b882574b: Status 404 returned error can't find the container with id 1e013f19f269cc19068c1b8942790dcdfeb18f1151772907ddedc755b882574b Jun 11 12:25:10.908015 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.907986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" event={"ID":"09d1d311-3a5b-4626-8c97-7c73739e08ed","Type":"ContainerStarted","Data":"1e013f19f269cc19068c1b8942790dcdfeb18f1151772907ddedc755b882574b"} Jun 11 12:25:10.999900 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:10.999821 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b77c789b9-cmtfc"] Jun 11 12:25:11.004357 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.004342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.007043 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007017 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 12:25:11.007188 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007022 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 12:25:11.007403 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007363 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9glh7\"" Jun 11 12:25:11.007403 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007379 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 12:25:11.007618 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007381 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 12:25:11.007618 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.007363 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 12:25:11.012043 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.012024 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 12:25:11.014882 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.014862 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b77c789b9-cmtfc"] Jun 11 12:25:11.136016 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.135984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-serving-certs-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsc5p\" (UniqueName: \"kubernetes.io/projected/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-kube-api-access-qsc5p\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136276 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-federate-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136348 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136384 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136416 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-metrics-client-ca\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.136449 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.136434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237073 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-federate-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237073 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-metrics-client-ca\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-serving-certs-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.237617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.237306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsc5p\" (UniqueName: \"kubernetes.io/projected/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-kube-api-access-qsc5p\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.238042 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.238018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-metrics-client-ca\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.238148 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.238128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.238292 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.238270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-serving-certs-ca-bundle\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.239642 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.239610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.239739 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.239697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-federate-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.240060 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.240040 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-telemeter-client-tls\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.240096 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.240050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.246788 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.246763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsc5p\" (UniqueName: \"kubernetes.io/projected/5a2f2782-eaca-41ae-a283-61a5daf0eb4e-kube-api-access-qsc5p\") pod \"telemeter-client-7b77c789b9-cmtfc\" (UID: \"5a2f2782-eaca-41ae-a283-61a5daf0eb4e\") " pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.314396 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.314318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" Jun 11 12:25:11.482037 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.481986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b77c789b9-cmtfc"] Jun 11 12:25:11.483342 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:11.483316 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2f2782_eaca_41ae_a283_61a5daf0eb4e.slice/crio-d51f3e904c85dd16cf16b6375842f86035c4c7d1dd3fba6bbd79f1d8f8b2f4bc WatchSource:0}: Error finding container d51f3e904c85dd16cf16b6375842f86035c4c7d1dd3fba6bbd79f1d8f8b2f4bc: Status 404 returned error can't find the container with id d51f3e904c85dd16cf16b6375842f86035c4c7d1dd3fba6bbd79f1d8f8b2f4bc Jun 11 12:25:11.913508 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:11.913427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" event={"ID":"5a2f2782-eaca-41ae-a283-61a5daf0eb4e","Type":"ContainerStarted","Data":"d51f3e904c85dd16cf16b6375842f86035c4c7d1dd3fba6bbd79f1d8f8b2f4bc"} Jun 11 12:25:12.919532 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:12.919492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" event={"ID":"09d1d311-3a5b-4626-8c97-7c73739e08ed","Type":"ContainerStarted","Data":"19616b9116c5f1990b904e1bf1fe59b4cc56619290330e28b6dca36b1cb3dd82"} Jun 11 12:25:12.920008 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:12.919693 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:12.924833 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:12.924805 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" Jun 11 12:25:12.935762 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:12.935717 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sdvdf" podStartSLOduration=1.583765043 podStartE2EDuration="2.935696986s" totalImagesPullingTime="1.351931943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:12.934866785 +0000 UTC m=+260.233243311" watchObservedRunningTime="2026-06-11 12:25:12.935696986 +0000 UTC m=+260.234073489" Jun 11 12:25:14.931523 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:14.931487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" event={"ID":"5a2f2782-eaca-41ae-a283-61a5daf0eb4e","Type":"ContainerStarted","Data":"a9244b00ffdab2b94c6d815539d3af39d35b774e6815776bc51dad8e2cd7987b"} Jun 11 12:25:15.937092 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:15.937056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" event={"ID":"5a2f2782-eaca-41ae-a283-61a5daf0eb4e","Type":"ContainerStarted","Data":"a38a38b290cadbb020615dd7c95a5645b7cd0529a4e85f20c985cfe30aedab37"} Jun 11 12:25:15.937519 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:15.937112 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" event={"ID":"5a2f2782-eaca-41ae-a283-61a5daf0eb4e","Type":"ContainerStarted","Data":"99f1f5bdb13cacbca6b9f58a51fbdc8f277e69d4c5cb5aa8df37c9742b9c9c2d"} Jun 11 12:25:15.963008 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:15.962958 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b77c789b9-cmtfc" podStartSLOduration=2.585430628 podStartE2EDuration="5.96294338s" totalImagesPullingTime="3.377512752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:15.962075648 +0000 UTC m=+263.260452151" watchObservedRunningTime="2026-06-11 12:25:15.96294338 +0000 UTC m=+263.261319882" Jun 11 12:25:16.065641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.065606 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:25:16.104016 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.103986 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:25:16.107306 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.107288 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.119074 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.119048 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:25:16.184116 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184268 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184268 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184268 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184386 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184386 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.184386 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.184311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbn42\" (UniqueName: \"kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285746 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285746 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285746 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbn42\" (UniqueName: \"kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.285986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.285947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.286546 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.286520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.286641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.286520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.286641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.286567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.286716 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.286675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.288327 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.288311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.288572 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.288554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.295551 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.295530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbn42\" (UniqueName: \"kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42\") pod \"console-95946b74c-h2jks\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.415749 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.415715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:16.545698 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.545516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:25:16.548187 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:16.548161 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490a2147_d66f_4d6f_939d_2d2298502506.slice/crio-4f0d29854044b34bfc64d3f6bdd861e2dbcc807b8c9f95b750f0655bf90bd7b8 WatchSource:0}: Error finding container 4f0d29854044b34bfc64d3f6bdd861e2dbcc807b8c9f95b750f0655bf90bd7b8: Status 404 returned error can't find the container with id 4f0d29854044b34bfc64d3f6bdd861e2dbcc807b8c9f95b750f0655bf90bd7b8 Jun 11 12:25:16.942313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.942272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95946b74c-h2jks" event={"ID":"490a2147-d66f-4d6f-939d-2d2298502506","Type":"ContainerStarted","Data":"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96"} Jun 11 12:25:16.942718 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.942368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95946b74c-h2jks" event={"ID":"490a2147-d66f-4d6f-939d-2d2298502506","Type":"ContainerStarted","Data":"4f0d29854044b34bfc64d3f6bdd861e2dbcc807b8c9f95b750f0655bf90bd7b8"} Jun 11 12:25:16.963253 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:16.963188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-95946b74c-h2jks" podStartSLOduration=0.963175727 podStartE2EDuration="963.175727ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:16.962787709 +0000 UTC m=+264.261164212" watchObservedRunningTime="2026-06-11 12:25:16.963175727 +0000 UTC m=+264.261552228" Jun 11 12:25:26.416453 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:26.416411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:26.416861 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:26.416473 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:25:26.417683 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:26.417662 2559 patch_prober.go:28] interesting pod/console-95946b74c-h2jks container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 12:25:26.417781 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:26.417707 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-95946b74c-h2jks" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 12:25:33.000826 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:33.000789 2559 generic.go:356] "Generic (PLEG): container finished" podID="253d2f4a-dae8-4c5f-83b8-7cc9a6175492" containerID="1c647509034f68fe729fd72d6bbea994591fe37e969160fb682836f847f42d5a" exitCode=0 Jun 11 12:25:33.001354 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:33.000850 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" event={"ID":"253d2f4a-dae8-4c5f-83b8-7cc9a6175492","Type":"ContainerDied","Data":"1c647509034f68fe729fd72d6bbea994591fe37e969160fb682836f847f42d5a"} Jun 11 12:25:33.001354 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:33.001243 2559 scope.go:117] "RemoveContainer" containerID="1c647509034f68fe729fd72d6bbea994591fe37e969160fb682836f847f42d5a" Jun 11 12:25:34.006848 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:34.006812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-gdfbh" event={"ID":"253d2f4a-dae8-4c5f-83b8-7cc9a6175492","Type":"ContainerStarted","Data":"f585c216ca978212bb472f92446cb38effcf20950101fcff6b71cc132f0b5c98"} Jun 11 12:25:35.583974 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:25:35.583933 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xpf2j" podUID="749d36cc-42b9-45e5-8142-b45dcb27f05f" Jun 11 12:25:35.584369 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:25:35.583989 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77c754656-2j74s" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" Jun 11 12:25:36.014537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:36.014504 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:25:36.014700 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:36.014508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:36.416722 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:36.416688 2559 patch_prober.go:28] interesting pod/console-95946b74c-h2jks container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 12:25:36.416881 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:36.416752 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-95946b74c-h2jks" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 12:25:38.023105 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:38.023025 2559 generic.go:356] "Generic (PLEG): container finished" podID="41c26904-9ef4-4837-8610-5b700bdf2ae3" containerID="ba4671771b58d1ce333b0e827aa1ae15c646d84fe3af6c79a85315e2fc9b97b8" exitCode=0 Jun 11 12:25:38.023105 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:38.023076 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r77sk" event={"ID":"41c26904-9ef4-4837-8610-5b700bdf2ae3","Type":"ContainerDied","Data":"ba4671771b58d1ce333b0e827aa1ae15c646d84fe3af6c79a85315e2fc9b97b8"} Jun 11 12:25:38.023557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:38.023387 2559 scope.go:117] "RemoveContainer" containerID="ba4671771b58d1ce333b0e827aa1ae15c646d84fe3af6c79a85315e2fc9b97b8" Jun 11 12:25:39.030529 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.030486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r77sk" event={"ID":"41c26904-9ef4-4837-8610-5b700bdf2ae3","Type":"ContainerStarted","Data":"ad69d2fee940f8ef46ccb5310dcd392856977b8172f79fd5cd2ca88e96ce180b"} Jun 11 12:25:39.088698 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.088654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:39.088879 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.088722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:25:39.094514 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.094482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/749d36cc-42b9-45e5-8142-b45dcb27f05f-metrics-tls\") pod \"dns-default-xpf2j\" (UID: \"749d36cc-42b9-45e5-8142-b45dcb27f05f\") " pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:39.094894 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.094871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"image-registry-77c754656-2j74s\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:25:39.317922 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.317839 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-54jbl\"" Jun 11 12:25:39.317922 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.317842 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksp79\"" Jun 11 12:25:39.326073 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.326049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:39.326231 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.326147 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:25:39.458165 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.458092 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xpf2j"] Jun 11 12:25:39.461906 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:39.461880 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749d36cc_42b9_45e5_8142_b45dcb27f05f.slice/crio-f27944a921c7a8d9a37696bc5cb1cf831ef0f8f692a190d6b1e93e0ed7990886 WatchSource:0}: Error finding container f27944a921c7a8d9a37696bc5cb1cf831ef0f8f692a190d6b1e93e0ed7990886: Status 404 returned error can't find the container with id f27944a921c7a8d9a37696bc5cb1cf831ef0f8f692a190d6b1e93e0ed7990886 Jun 11 12:25:39.479458 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:39.479430 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:25:39.482700 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:25:39.482678 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e86c20_af39_4ef2_901a_fbfc5e9cd7bd.slice/crio-0b695a92c85e3362592c00eba9a74777f54f7e05741897f2377dbbf36a67dd77 WatchSource:0}: Error finding container 0b695a92c85e3362592c00eba9a74777f54f7e05741897f2377dbbf36a67dd77: Status 404 returned error can't find the container with id 0b695a92c85e3362592c00eba9a74777f54f7e05741897f2377dbbf36a67dd77 Jun 11 12:25:40.035386 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:40.035350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c754656-2j74s" event={"ID":"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd","Type":"ContainerStarted","Data":"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1"} Jun 11 12:25:40.035870 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:40.035400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c754656-2j74s" event={"ID":"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd","Type":"ContainerStarted","Data":"0b695a92c85e3362592c00eba9a74777f54f7e05741897f2377dbbf36a67dd77"} Jun 11 12:25:40.035870 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:40.035434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:25:40.036512 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:40.036489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf2j" event={"ID":"749d36cc-42b9-45e5-8142-b45dcb27f05f","Type":"ContainerStarted","Data":"f27944a921c7a8d9a37696bc5cb1cf831ef0f8f692a190d6b1e93e0ed7990886"} Jun 11 12:25:40.057154 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:40.057104 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c754656-2j74s" podStartSLOduration=287.057086268 podStartE2EDuration="4m47.057086268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:40.056051142 +0000 UTC m=+287.354427642" watchObservedRunningTime="2026-06-11 12:25:40.057086268 +0000 UTC m=+287.355462771" Jun 11 12:25:41.085582 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:41.085531 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d98c5557c-hdzjc" podUID="4693f5d1-372e-4490-972f-c79a898efc92" containerName="console" containerID="cri-o://008bf6403e819d0bd7702dcce4aefe7b189a28ba7bcb3e4fc446cb68f5d096fa" gracePeriod=15 Jun 11 12:25:41.240761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:41.240711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-knv7m_4b018ed3-e104-4973-b6ea-f564dc0ea453/cluster-monitoring-operator/0.log" Jun 11 12:25:42.046456 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.046424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf2j" event={"ID":"749d36cc-42b9-45e5-8142-b45dcb27f05f","Type":"ContainerStarted","Data":"0418143e2ba09ced4b8cdde3817f1a9a3c17911345ac63be91e8820c69377bc3"} Jun 11 12:25:42.046620 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.046473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf2j" event={"ID":"749d36cc-42b9-45e5-8142-b45dcb27f05f","Type":"ContainerStarted","Data":"96b4dff76002503b7070b091f574660de1ac914f0f408467378b780f83fefb9f"} Jun 11 12:25:42.046620 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.046558 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:42.065742 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.065693 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xpf2j" podStartSLOduration=251.117372141 podStartE2EDuration="4m13.065679618s" totalImagesPullingTime="1.948307477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:25:42.065510863 +0000 UTC m=+289.363887368" watchObservedRunningTime="2026-06-11 12:25:42.065679618 +0000 UTC m=+289.364056123" Jun 11 12:25:42.239820 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.239790 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-sdvdf_09d1d311-3a5b-4626-8c97-7c73739e08ed/monitoring-plugin/0.log" Jun 11 12:25:42.438652 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.438626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/init-textfile/0.log" Jun 11 12:25:42.638856 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.638833 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/node-exporter/0.log" Jun 11 12:25:42.838483 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:42.838412 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/kube-rbac-proxy/0.log" Jun 11 12:25:43.051406 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:43.051371 2559 generic.go:356] "Generic (PLEG): container finished" podID="e94a81c8-ba5a-46f6-9846-9011c61784b2" containerID="3ef4e1c70841a0c8e37ab075c945d4966ad81d6b9bd859d9051a67bce718a1ad" exitCode=0 Jun 11 12:25:43.051560 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:43.051443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" event={"ID":"e94a81c8-ba5a-46f6-9846-9011c61784b2","Type":"ContainerDied","Data":"3ef4e1c70841a0c8e37ab075c945d4966ad81d6b9bd859d9051a67bce718a1ad"} Jun 11 12:25:43.051840 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:43.051828 2559 scope.go:117] "RemoveContainer" containerID="3ef4e1c70841a0c8e37ab075c945d4966ad81d6b9bd859d9051a67bce718a1ad" Jun 11 12:25:44.056939 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:44.056904 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pjss9" event={"ID":"e94a81c8-ba5a-46f6-9846-9011c61784b2","Type":"ContainerStarted","Data":"4f077e6c2a411bd810f6b9eea50194c75d67b72848215fea7a0ed31b7c250868"} Jun 11 12:25:45.238939 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:45.238910 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gs8np_b4897df5-929b-43c6-a0c8-1de3a45a5c1a/prometheus-operator-admission-webhook/0.log" Jun 11 12:25:45.438883 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:45.438854 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/telemeter-client/0.log" Jun 11 12:25:45.638959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:45.638934 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/reload/0.log" Jun 11 12:25:45.838965 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:45.838937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/kube-rbac-proxy/0.log" Jun 11 12:25:46.038999 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:46.038919 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c5xz4_7d5164ae-085d-47cc-b0c5-0eecb75d5cbb/networking-console-plugin/0.log" Jun 11 12:25:46.417093 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:46.417059 2559 patch_prober.go:28] interesting pod/console-95946b74c-h2jks container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 12:25:46.417492 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:46.417106 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-95946b74c-h2jks" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 12:25:46.839711 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:46.839644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d98c5557c-hdzjc_4693f5d1-372e-4490-972f-c79a898efc92/console/0.log" Jun 11 12:25:47.044098 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:47.044072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-95946b74c-h2jks_490a2147-d66f-4d6f-939d-2d2298502506/console/0.log" Jun 11 12:25:48.238849 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:48.238822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf2j_749d36cc-42b9-45e5-8142-b45dcb27f05f/dns/0.log" Jun 11 12:25:48.438639 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:48.438613 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf2j_749d36cc-42b9-45e5-8142-b45dcb27f05f/kube-rbac-proxy/0.log" Jun 11 12:25:48.638396 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:48.638373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69zsg_76f11c9b-915f-42d5-af54-b5b63509c584/dns-node-resolver/0.log" Jun 11 12:25:49.439186 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:49.439156 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77c754656-2j74s_b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd/registry/0.log" Jun 11 12:25:49.639179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:49.639148 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9d72r_d7feef61-f359-47fb-bcde-6fb39769cf6a/node-ca/0.log" Jun 11 12:25:50.439864 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:50.439838 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59252_8c1a4ff3-4173-40a4-a0e5-162d7df22396/serve-healthcheck-canary/0.log" Jun 11 12:25:52.053727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:52.053698 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xpf2j" Jun 11 12:25:53.050221 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:53.050178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:25:53.064575 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:53.064549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:25:53.066045 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:53.066022 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 12:25:54.097250 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.097188 2559 generic.go:356] "Generic (PLEG): container finished" podID="4693f5d1-372e-4490-972f-c79a898efc92" containerID="008bf6403e819d0bd7702dcce4aefe7b189a28ba7bcb3e4fc446cb68f5d096fa" exitCode=0 Jun 11 12:25:54.097826 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.097795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98c5557c-hdzjc" event={"ID":"4693f5d1-372e-4490-972f-c79a898efc92","Type":"ContainerDied","Data":"008bf6403e819d0bd7702dcce4aefe7b189a28ba7bcb3e4fc446cb68f5d096fa"} Jun 11 12:25:54.153894 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.153869 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:54.220294 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220191 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220294 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220280 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220300 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220315 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220333 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220357 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220382 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") pod \"4693f5d1-372e-4490-972f-c79a898efc92\" (UID: \"4693f5d1-372e-4490-972f-c79a898efc92\") " Jun 11 12:25:54.220763 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220735 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config" (OuterVolumeSpecName: "console-config") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:54.220813 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220750 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca" (OuterVolumeSpecName: "service-ca") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:54.220813 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220775 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:54.220917 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.220838 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:25:54.222558 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.222533 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:25:54.222731 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.222708 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs" (OuterVolumeSpecName: "kube-api-access-rppxs") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "kube-api-access-rppxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:25:54.222834 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.222724 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4693f5d1-372e-4490-972f-c79a898efc92" (UID: "4693f5d1-372e-4490-972f-c79a898efc92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:25:54.321082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321038 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rppxs\" (UniqueName: \"kubernetes.io/projected/4693f5d1-372e-4490-972f-c79a898efc92-kube-api-access-rppxs\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321075 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-service-ca\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321088 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-serving-cert\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321362 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321101 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-console-config\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321362 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321113 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-trusted-ca-bundle\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321362 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321124 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4693f5d1-372e-4490-972f-c79a898efc92-oauth-serving-cert\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:54.321362 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:54.321135 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4693f5d1-372e-4490-972f-c79a898efc92-console-oauth-config\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:25:55.102510 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:55.102486 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98c5557c-hdzjc" Jun 11 12:25:55.102884 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:55.102488 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98c5557c-hdzjc" event={"ID":"4693f5d1-372e-4490-972f-c79a898efc92","Type":"ContainerDied","Data":"d90d96eaebb083146eda8f9eda315e422352366095d33671f6f4f419aaa6c9d6"} Jun 11 12:25:55.102884 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:55.102621 2559 scope.go:117] "RemoveContainer" containerID="008bf6403e819d0bd7702dcce4aefe7b189a28ba7bcb3e4fc446cb68f5d096fa" Jun 11 12:25:55.118969 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:55.118948 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:25:55.125310 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:55.125292 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d98c5557c-hdzjc"] Jun 11 12:25:56.417149 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:56.417110 2559 patch_prober.go:28] interesting pod/console-95946b74c-h2jks container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jun 11 12:25:56.417551 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:56.417177 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-95946b74c-h2jks" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jun 11 12:25:57.087760 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:57.087729 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4693f5d1-372e-4490-972f-c79a898efc92" path="/var/lib/kubelet/pods/4693f5d1-372e-4490-972f-c79a898efc92/volumes" Jun 11 12:25:59.331014 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:59.330975 2559 patch_prober.go:28] interesting pod/image-registry-77c754656-2j74s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:25:59.331400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:25:59.331030 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77c754656-2j74s" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:26:01.045639 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:01.045613 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:26:06.420047 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:06.420014 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:26:06.423681 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:06.423643 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:26:25.654648 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:25.654615 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:26:50.679745 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.679644 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c754656-2j74s" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerName="registry" containerID="cri-o://49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1" gracePeriod=30 Jun 11 12:26:50.919239 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.919201 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:26:50.987115 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987115 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987073 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9j5s\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987115 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987111 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987417 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987293 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987417 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987359 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987417 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987414 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987438 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.987566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.987503 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") pod \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\" (UID: \"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd\") " Jun 11 12:26:50.988108 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.988071 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:50.988361 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.988318 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:26:50.989685 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.989655 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:26:50.989685 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.989673 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s" (OuterVolumeSpecName: "kube-api-access-f9j5s") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "kube-api-access-f9j5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:26:50.989864 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.989784 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:26:50.989864 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.989813 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:26:50.989940 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.989912 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:26:50.996195 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:50.996169 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" (UID: "b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:26:51.088735 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088707 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-image-registry-private-configuration\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088735 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088732 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-installation-pull-secrets\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088735 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088742 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-ca-trust-extracted\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088751 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-certificates\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088761 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-trusted-ca\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088769 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-registry-tls\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088777 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-bound-sa-token\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.088959 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.088785 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9j5s\" (UniqueName: \"kubernetes.io/projected/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd-kube-api-access-f9j5s\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:26:51.310005 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.309913 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerID="49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1" exitCode=0 Jun 11 12:26:51.310005 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.309975 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c754656-2j74s" Jun 11 12:26:51.310181 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.310008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c754656-2j74s" event={"ID":"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd","Type":"ContainerDied","Data":"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1"} Jun 11 12:26:51.310181 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.310087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c754656-2j74s" event={"ID":"b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd","Type":"ContainerDied","Data":"0b695a92c85e3362592c00eba9a74777f54f7e05741897f2377dbbf36a67dd77"} Jun 11 12:26:51.310181 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.310108 2559 scope.go:117] "RemoveContainer" containerID="49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1" Jun 11 12:26:51.318131 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.318108 2559 scope.go:117] "RemoveContainer" containerID="49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1" Jun 11 12:26:51.318410 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:26:51.318389 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1\": container with ID starting with 49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1 not found: ID does not exist" containerID="49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1" Jun 11 12:26:51.318485 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.318418 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1"} err="failed to get container status \"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1\": rpc error: code = NotFound desc = could not find container \"49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1\": container with ID starting with 49ace7be144ab88e910d7e2ad802e05d8dac38ce40f7755ce47be8531be052f1 not found: ID does not exist" Jun 11 12:26:51.328638 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.328615 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:26:51.333021 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:51.332999 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c754656-2j74s"] Jun 11 12:26:53.088176 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:26:53.088147 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" path="/var/lib/kubelet/pods/b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd/volumes" Jun 11 12:27:47.224182 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:27:47.224142 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-qmgwj" podUID="803d25bc-5008-4c23-a145-7ee8e0de0ca8" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:27:47.224668 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:27:47.224272 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:27:47.224937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:27:47.224911 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-qmgwj" podUID="803d25bc-5008-4c23-a145-7ee8e0de0ca8" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:28:17.225528 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:28:17.225451 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qmgwj" Jun 11 12:30:10.007926 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.007890 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008336 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerName="registry" Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008355 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerName="registry" Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008385 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4693f5d1-372e-4490-972f-c79a898efc92" containerName="console" Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008393 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4693f5d1-372e-4490-972f-c79a898efc92" containerName="console" Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008472 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e86c20-af39-4ef2-901a-fbfc5e9cd7bd" containerName="registry" Jun 11 12:30:10.008501 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.008483 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4693f5d1-372e-4490-972f-c79a898efc92" containerName="console" Jun 11 12:30:10.011840 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.011818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.014311 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014289 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 12:30:10.014485 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014365 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 12:30:10.014618 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014591 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 12:30:10.014724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 12:30:10.014724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014686 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 12:30:10.014724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014685 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 12:30:10.014895 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014692 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kzqcq\"" Jun 11 12:30:10.014895 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.014811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 12:30:10.015082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.015058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 12:30:10.017367 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017462 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017462 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017462 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017570 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017570 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017641 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017712 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.017896 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.017831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx77\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-kube-api-access-rmx77\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.020119 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.020101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 12:30:10.038800 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.038776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 12:30:10.119020 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.118990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119020 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119292 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119292 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:30:10.119138 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 12:30:10.119292 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx77\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-kube-api-access-rmx77\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119292 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:30:10.119223 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls podName:5f1f4ab2-cf9e-4f32-98cb-2a131014be24 nodeName:}" failed. No retries permitted until 2026-06-11 12:30:10.619189726 +0000 UTC m=+557.917566209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5f1f4ab2-cf9e-4f32-98cb-2a131014be24") : secret "alertmanager-main-tls" not found Jun 11 12:30:10.119292 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.119566 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.120044 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.119729 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.120272 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.120247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.120812 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.120721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122012 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.121980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122458 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.122937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.123164 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.122966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.123164 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.123013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.128977 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.128957 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx77\" (UniqueName: \"kubernetes.io/projected/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-kube-api-access-rmx77\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.624272 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.624227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.626586 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.626562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f4ab2-cf9e-4f32-98cb-2a131014be24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f4ab2-cf9e-4f32-98cb-2a131014be24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:10.922176 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:10.922143 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 12:30:11.035089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.035060 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cbbf5954c-fd69h"] Jun 11 12:30:11.038879 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.038863 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.041805 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.041780 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 12:30:11.041931 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.041899 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 12:30:11.042038 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.042019 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gcz5s\"" Jun 11 12:30:11.042162 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.042132 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 12:30:11.042351 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.042338 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cguatl3o8njr9\"" Jun 11 12:30:11.042424 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.042393 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 12:30:11.042841 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.042822 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 12:30:11.059627 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.059604 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbbf5954c-fd69h"] Jun 11 12:30:11.088803 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.088783 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 12:30:11.089443 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:30:11.089424 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1f4ab2_cf9e_4f32_98cb_2a131014be24.slice/crio-e08aea47c9ffd6931144aeb41900e1504b4d3201a5407171a1f33dd4f4756976 WatchSource:0}: Error finding container e08aea47c9ffd6931144aeb41900e1504b4d3201a5407171a1f33dd4f4756976: Status 404 returned error can't find the container with id e08aea47c9ffd6931144aeb41900e1504b4d3201a5407171a1f33dd4f4756976 Jun 11 12:30:11.127390 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127496 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127552 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127602 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127655 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-grpc-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127702 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mzm\" (UniqueName: \"kubernetes.io/projected/a080fc83-643d-4687-9d72-659400393555-kube-api-access-59mzm\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127738 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a080fc83-643d-4687-9d72-659400393555-metrics-client-ca\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.127773 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.127748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-grpc-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mzm\" (UniqueName: \"kubernetes.io/projected/a080fc83-643d-4687-9d72-659400393555-kube-api-access-59mzm\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a080fc83-643d-4687-9d72-659400393555-metrics-client-ca\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.228853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.229154 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.228990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.229631 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.229585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a080fc83-643d-4687-9d72-659400393555-metrics-client-ca\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231416 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-grpc-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231522 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231631 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231611 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231702 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231840 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.231903 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.231887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a080fc83-643d-4687-9d72-659400393555-secret-thanos-querier-tls\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.238252 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.238189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mzm\" (UniqueName: \"kubernetes.io/projected/a080fc83-643d-4687-9d72-659400393555-kube-api-access-59mzm\") pod \"thanos-querier-5cbbf5954c-fd69h\" (UID: \"a080fc83-643d-4687-9d72-659400393555\") " pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.348863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.348829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:11.477065 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.477036 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbbf5954c-fd69h"] Jun 11 12:30:11.479897 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:30:11.479868 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda080fc83_643d_4687_9d72_659400393555.slice/crio-178eebb67fbdd10ea87ee5e76957741fa8c1839b2e27c8e32ea27277593d595d WatchSource:0}: Error finding container 178eebb67fbdd10ea87ee5e76957741fa8c1839b2e27c8e32ea27277593d595d: Status 404 returned error can't find the container with id 178eebb67fbdd10ea87ee5e76957741fa8c1839b2e27c8e32ea27277593d595d Jun 11 12:30:11.481839 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:11.481824 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:30:12.030856 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:12.030817 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"178eebb67fbdd10ea87ee5e76957741fa8c1839b2e27c8e32ea27277593d595d"} Jun 11 12:30:12.032310 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:12.032286 2559 generic.go:356] "Generic (PLEG): container finished" podID="5f1f4ab2-cf9e-4f32-98cb-2a131014be24" containerID="c6ef0346c05e6dc69d65fda22ecf47c757a1c73cbb1a909a804860698a90f029" exitCode=0 Jun 11 12:30:12.032435 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:12.032319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerDied","Data":"c6ef0346c05e6dc69d65fda22ecf47c757a1c73cbb1a909a804860698a90f029"} Jun 11 12:30:12.032435 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:12.032367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"e08aea47c9ffd6931144aeb41900e1504b4d3201a5407171a1f33dd4f4756976"} Jun 11 12:30:15.049309 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.049253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"904f34b19aac4e2302b30041ef773740064a782c9e60288aa05424278c07b8cb"} Jun 11 12:30:15.049780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.049343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"442e75c904ff85ad599da7a96bca04d6d820ee1bcb19c91f64b232b47d06de8e"} Jun 11 12:30:15.049780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.049405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"f7a69b09e3f0eb4c808b106d16071c8242645b568deeda8d635cfaa5e1ae6e73"} Jun 11 12:30:15.049780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.049436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"e565448227fb202da0c2f1d99b24178d956406e01ef1fa1936bf02ef08a7ad40"} Jun 11 12:30:15.049780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.049473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"e1713482b7cd97aaa79e1515729d12c3694081d6d251bf3e13e9d16f26128bc8"} Jun 11 12:30:15.051946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.051917 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"e693813685c5f02c04cfce66979f183d3ea8bc70a102308052b0c7d009bc7b64"} Jun 11 12:30:15.052063 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.051994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"bd35ba76dc63cdab1e876669268b17b1d028d64ccdb55353b2ad9af79ead0ecc"} Jun 11 12:30:15.052063 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.052037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"d075700121cd03fdf5eb4abbd55a809070441282ff7442f67fbb27e3191e6e79"} Jun 11 12:30:15.181436 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.181401 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:30:15.185584 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.185562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.188006 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.187923 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 12:30:15.189159 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.188512 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 12:30:15.190853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.190318 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 12:30:15.190853 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.190729 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 12:30:15.191033 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.190935 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.191743 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5np9k\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.192430 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.192438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.192532 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.192824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5dntrmtkhsrkj\"" Jun 11 12:30:15.193644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.193423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 12:30:15.194179 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.194158 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 12:30:15.194735 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.194716 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 12:30:15.195666 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.195313 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 12:30:15.195666 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.195352 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 12:30:15.197582 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.197557 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 12:30:15.200449 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.200020 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 12:30:15.202119 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.202094 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:30:15.266822 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.266991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.266991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.266991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.266991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vsj\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-kube-api-access-p7vsj\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.266991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.266996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.267709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.267394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368157 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vsj\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-kube-api-access-p7vsj\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368323 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368323 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368436 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368436 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.368984 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.368848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.369134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.369105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.369613 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.370817 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.370861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.370909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.370942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.370972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.371333 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372289 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.371960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.372455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.372724 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.372571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.373904 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.373020 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.373904 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.373056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.373904 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.373644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374416 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374689 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374797 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374797 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374797 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.374975 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.374858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.375480 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.375457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.376134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.376116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.376688 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.376671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vsj\" (UniqueName: \"kubernetes.io/projected/4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d-kube-api-access-p7vsj\") pod \"prometheus-k8s-0\" (UID: \"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.504271 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.504250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:15.650771 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:15.650743 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:30:15.654283 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:30:15.654258 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7ba4b9_0c6d_4c27_b8f0_63f04f40ec0d.slice/crio-a5d1d6a7728a29af9c4d2cf27ffa9f73a2a73910d941170eafd493a63f1aeb8c WatchSource:0}: Error finding container a5d1d6a7728a29af9c4d2cf27ffa9f73a2a73910d941170eafd493a63f1aeb8c: Status 404 returned error can't find the container with id a5d1d6a7728a29af9c4d2cf27ffa9f73a2a73910d941170eafd493a63f1aeb8c Jun 11 12:30:16.059016 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.058934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f4ab2-cf9e-4f32-98cb-2a131014be24","Type":"ContainerStarted","Data":"0598f98ca088cd7c195a7d4f8475e6895e99a127cc4d7a48dbf4115a98ba68a6"} Jun 11 12:30:16.060400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.060376 2559 generic.go:356] "Generic (PLEG): container finished" podID="4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d" containerID="b2cbde820068c6de003383676be15dffcd43fff4c9538574f1c3b5c76be4f9b5" exitCode=0 Jun 11 12:30:16.060550 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.060406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerDied","Data":"b2cbde820068c6de003383676be15dffcd43fff4c9538574f1c3b5c76be4f9b5"} Jun 11 12:30:16.060550 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.060478 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"a5d1d6a7728a29af9c4d2cf27ffa9f73a2a73910d941170eafd493a63f1aeb8c"} Jun 11 12:30:16.063608 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.063586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"caa5fa76a497e40eb0ccb50aa271f8df25798f44b68f282ec88947e11b03edb2"} Jun 11 12:30:16.063701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.063645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"0838ac22cdee5da1db8eeff78def3aac93b51e3e7cc3df6d3039a259aaf7534a"} Jun 11 12:30:16.063701 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.063682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" event={"ID":"a080fc83-643d-4687-9d72-659400393555","Type":"ContainerStarted","Data":"d724087421f62b972149ef4f5d9bf3da8c365e54b068377f72f2321daa9a2c16"} Jun 11 12:30:16.063808 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.063728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:16.098150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.098108 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.093875996 podStartE2EDuration="7.098094824s" totalImagesPullingTime="2.986309349s" totalInitContainerRuntime="17.909479ms" isStatefulPod=false podCreationTimestamp="2026-06-11 12:30:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:30:16.096332052 +0000 UTC m=+563.394708554" watchObservedRunningTime="2026-06-11 12:30:16.098094824 +0000 UTC m=+563.396471372" Jun 11 12:30:16.133848 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:16.133731 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" podStartSLOduration=1.4687941979999999 podStartE2EDuration="5.133703723s" totalImagesPullingTime="3.664909525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:30:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:30:16.133661168 +0000 UTC m=+563.432037695" watchObservedRunningTime="2026-06-11 12:30:16.133703723 +0000 UTC m=+563.432080221" Jun 11 12:30:20.088122 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088080 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"1a9496e2ca122c3853dd6e2f3c963b0d74200ff8413a46e5e53a10172c528203"} Jun 11 12:30:20.088557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"37e988ab855f37800884a786579a38e2a3b0254bc808f10083b1eee2f8288235"} Jun 11 12:30:20.088557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"96db182380fdd42fcbf2f86fa94d82257df20b57c64b9dd40322d701609c3373"} Jun 11 12:30:20.088557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"426ca0c4461fca154ff534444f1f7b05972177925a184a80a12d340e9b8898a4"} Jun 11 12:30:20.088557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088290 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"16ce65c314c26a5b815c78f287b02215f88c1ebffacd6444c3475519dc5b6a45"} Jun 11 12:30:20.088557 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.088333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d","Type":"ContainerStarted","Data":"efdc81df4fef26d1cf489f1cec32039e4c6f35b2b2d3ec3c61bf2af650c1d133"} Jun 11 12:30:20.124661 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.124612 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.863312962 podStartE2EDuration="5.124574063s" totalImagesPullingTime="3.242506976s" totalInitContainerRuntime="18.754125ms" isStatefulPod=false podCreationTimestamp="2026-06-11 12:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:30:20.121557571 +0000 UTC m=+567.419934079" watchObservedRunningTime="2026-06-11 12:30:20.124574063 +0000 UTC m=+567.422950565" Jun 11 12:30:20.505251 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:20.505189 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:30:22.078046 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:22.078017 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cbbf5954c-fd69h" Jun 11 12:30:53.093150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:53.093119 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:30:53.093687 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:30:53.093389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:31:15.505458 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:31:15.505367 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:31:15.525335 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:31:15.525311 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:31:16.337873 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:31:16.337845 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:31:41.995543 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:31:41.995504 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:32:07.021223 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.021146 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-95946b74c-h2jks" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" containerID="cri-o://4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96" gracePeriod=15 Jun 11 12:32:07.270779 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.270751 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:32:07.361505 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361404 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361505 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361456 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361505 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361498 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361795 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361575 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361795 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361598 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361795 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361624 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.361795 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361646 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbn42\" (UniqueName: \"kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42\") pod \"490a2147-d66f-4d6f-939d-2d2298502506\" (UID: \"490a2147-d66f-4d6f-939d-2d2298502506\") " Jun 11 12:32:07.362025 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361996 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config" (OuterVolumeSpecName: "console-config") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:32:07.362150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.362116 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca" (OuterVolumeSpecName: "service-ca") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:32:07.362150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.361969 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:32:07.362150 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.362123 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:32:07.363769 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.363746 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:32:07.363855 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.363766 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42" (OuterVolumeSpecName: "kube-api-access-kbn42") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "kube-api-access-kbn42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:32:07.363855 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.363783 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "490a2147-d66f-4d6f-939d-2d2298502506" (UID: "490a2147-d66f-4d6f-939d-2d2298502506"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:32:07.462914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462858 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-console-config\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.462914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462907 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-oauth-config\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.462914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462918 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-oauth-serving-cert\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.462914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462927 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbn42\" (UniqueName: \"kubernetes.io/projected/490a2147-d66f-4d6f-939d-2d2298502506-kube-api-access-kbn42\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.462914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462937 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-trusted-ca-bundle\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.463274 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462945 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490a2147-d66f-4d6f-939d-2d2298502506-console-serving-cert\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.463274 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.462956 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490a2147-d66f-4d6f-939d-2d2298502506-service-ca\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:32:07.532864 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.532828 2559 generic.go:356] "Generic (PLEG): container finished" podID="490a2147-d66f-4d6f-939d-2d2298502506" containerID="4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96" exitCode=0 Jun 11 12:32:07.533053 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.532877 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95946b74c-h2jks" Jun 11 12:32:07.533053 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.532911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95946b74c-h2jks" event={"ID":"490a2147-d66f-4d6f-939d-2d2298502506","Type":"ContainerDied","Data":"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96"} Jun 11 12:32:07.533053 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.532962 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95946b74c-h2jks" event={"ID":"490a2147-d66f-4d6f-939d-2d2298502506","Type":"ContainerDied","Data":"4f0d29854044b34bfc64d3f6bdd861e2dbcc807b8c9f95b750f0655bf90bd7b8"} Jun 11 12:32:07.533053 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.532984 2559 scope.go:117] "RemoveContainer" containerID="4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96" Jun 11 12:32:07.542783 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.542767 2559 scope.go:117] "RemoveContainer" containerID="4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96" Jun 11 12:32:07.543051 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:32:07.543033 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96\": container with ID starting with 4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96 not found: ID does not exist" containerID="4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96" Jun 11 12:32:07.543094 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.543062 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96"} err="failed to get container status \"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96\": rpc error: code = NotFound desc = could not find container \"4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96\": container with ID starting with 4a46e31aa784501560de3be741b2ba82340d5e52121d572b87eb38e66bd40f96 not found: ID does not exist" Jun 11 12:32:07.555535 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.555506 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:32:07.559811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:07.559788 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95946b74c-h2jks"] Jun 11 12:32:09.087986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:32:09.087950 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490a2147-d66f-4d6f-939d-2d2298502506" path="/var/lib/kubelet/pods/490a2147-d66f-4d6f-939d-2d2298502506/volumes" Jun 11 12:35:53.127076 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:35:53.127047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:35:53.128610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:35:53.128593 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:39:00.230937 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.230904 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf"] Jun 11 12:39:00.231475 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.231457 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" Jun 11 12:39:00.231522 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.231479 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" Jun 11 12:39:00.231585 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.231574 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="490a2147-d66f-4d6f-939d-2d2298502506" containerName="console" Jun 11 12:39:00.234845 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.234827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.238785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.238760 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 12:39:00.238960 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.238858 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 12:39:00.238960 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.238939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 12:39:00.239162 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.239141 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 12:39:00.239539 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.239522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pn74x\"" Jun 11 12:39:00.264597 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.264571 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf"] Jun 11 12:39:00.319093 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.319060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.319277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.319109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.319277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.319132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.319277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.319149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwkd\" (UniqueName: \"kubernetes.io/projected/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-kube-api-access-xhwkd\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.319277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.319251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420607 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420607 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420607 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwkd\" (UniqueName: \"kubernetes.io/projected/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-kube-api-access-xhwkd\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420607 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.420938 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.420916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-manifests\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.422755 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.422729 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-tmp\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.423030 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.423013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.423111 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.423093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.431298 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.431271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwkd\" (UniqueName: \"kubernetes.io/projected/80b2143e-ed29-46e3-abf6-7cf7a9c7fc17-kube-api-access-xhwkd\") pod \"opendatahub-operator-controller-manager-5c94cd86bb-lt8gf\" (UID: \"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17\") " pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.545985 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.545911 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:00.689313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.689276 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf"] Jun 11 12:39:00.692627 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:39:00.692597 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b2143e_ed29_46e3_abf6_7cf7a9c7fc17.slice/crio-e47417560e75de3c9e8853d07f91117de8cfe551504c84477e8e71fe8a48936f WatchSource:0}: Error finding container e47417560e75de3c9e8853d07f91117de8cfe551504c84477e8e71fe8a48936f: Status 404 returned error can't find the container with id e47417560e75de3c9e8853d07f91117de8cfe551504c84477e8e71fe8a48936f Jun 11 12:39:00.694381 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:00.694365 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:39:01.217274 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:01.217238 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerStarted","Data":"e47417560e75de3c9e8853d07f91117de8cfe551504c84477e8e71fe8a48936f"} Jun 11 12:39:04.234948 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:04.234869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerStarted","Data":"ace95efbbaf1c3cda9a1277a008de8e6c5fb32da8a19dcb10710b90ec5cb87f1"} Jun 11 12:39:05.240352 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:05.240266 2559 generic.go:356] "Generic (PLEG): container finished" podID="80b2143e-ed29-46e3-abf6-7cf7a9c7fc17" containerID="ace95efbbaf1c3cda9a1277a008de8e6c5fb32da8a19dcb10710b90ec5cb87f1" exitCode=0 Jun 11 12:39:05.240352 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:05.240334 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerDied","Data":"ace95efbbaf1c3cda9a1277a008de8e6c5fb32da8a19dcb10710b90ec5cb87f1"} Jun 11 12:39:06.253820 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:06.253775 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerStarted","Data":"0bb344bf4fec41c0a423ffca1e3d3452c68215b6957c2a39ba269b48e7d0b25a"} Jun 11 12:39:06.254230 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:06.253888 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:06.288883 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:06.288832 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" podStartSLOduration=1.743922912 podStartE2EDuration="6.288817841s" totalImagesPullingTime="3.569322154s" totalInitContainerRuntime="975.572775ms" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:06.288315888 +0000 UTC m=+1093.586692388" watchObservedRunningTime="2026-06-11 12:39:06.288817841 +0000 UTC m=+1093.587194382" Jun 11 12:39:17.261360 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:17.261330 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:39:26.938635 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.938603 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz"] Jun 11 12:39:26.944595 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.944576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:26.951611 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.951585 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 12:39:26.951727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.951620 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 12:39:26.952567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.952550 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 12:39:26.952713 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.952696 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c99dh\"" Jun 11 12:39:26.952784 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.952767 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 12:39:26.952868 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.952848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:39:26.962790 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:26.962767 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz"] Jun 11 12:39:27.057438 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.057398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vv9\" (UniqueName: \"kubernetes.io/projected/6ba6f43a-5c62-4415-905c-70c62edc4dfb-kube-api-access-99vv9\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.057613 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.057498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-metrics-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.057613 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.057566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ba6f43a-5c62-4415-905c-70c62edc4dfb-manager-config\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.057613 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.057596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.158184 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.158148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-metrics-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.158382 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.158275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ba6f43a-5c62-4415-905c-70c62edc4dfb-manager-config\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.158382 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.158330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.158515 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.158386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vv9\" (UniqueName: \"kubernetes.io/projected/6ba6f43a-5c62-4415-905c-70c62edc4dfb-kube-api-access-99vv9\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.159073 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.159044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ba6f43a-5c62-4415-905c-70c62edc4dfb-manager-config\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.160679 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.160659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-metrics-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.160761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.160707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ba6f43a-5c62-4415-905c-70c62edc4dfb-cert\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.168912 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.168892 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vv9\" (UniqueName: \"kubernetes.io/projected/6ba6f43a-5c62-4415-905c-70c62edc4dfb-kube-api-access-99vv9\") pod \"lws-controller-manager-776fd58779-ktjgz\" (UID: \"6ba6f43a-5c62-4415-905c-70c62edc4dfb\") " pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.253532 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.253448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:27.390445 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:27.390419 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz"] Jun 11 12:39:27.392742 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:39:27.392711 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba6f43a_5c62_4415_905c_70c62edc4dfb.slice/crio-bec0fd7a409b0296d46b8bf43420db889de5373796d47bdf4e082a1de6f175e3 WatchSource:0}: Error finding container bec0fd7a409b0296d46b8bf43420db889de5373796d47bdf4e082a1de6f175e3: Status 404 returned error can't find the container with id bec0fd7a409b0296d46b8bf43420db889de5373796d47bdf4e082a1de6f175e3 Jun 11 12:39:28.362920 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:28.362883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" event={"ID":"6ba6f43a-5c62-4415-905c-70c62edc4dfb","Type":"ContainerStarted","Data":"bec0fd7a409b0296d46b8bf43420db889de5373796d47bdf4e082a1de6f175e3"} Jun 11 12:39:31.378284 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:31.378242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" event={"ID":"6ba6f43a-5c62-4415-905c-70c62edc4dfb","Type":"ContainerStarted","Data":"f361bd72d919671c1a61ec279c3a1a862aa8be9ab521460845821dccdc259a0d"} Jun 11 12:39:31.378759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:31.378324 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:31.403177 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:31.403127 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" podStartSLOduration=2.051107493 podStartE2EDuration="5.403112675s" totalImagesPullingTime="3.352005182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:31.400995232 +0000 UTC m=+1118.699371748" watchObservedRunningTime="2026-06-11 12:39:31.403112675 +0000 UTC m=+1118.701489177" Jun 11 12:39:42.385012 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:42.384982 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-776fd58779-ktjgz" Jun 11 12:39:50.235841 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.235808 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-xf568"] Jun 11 12:39:50.239465 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.239439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.242456 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.242436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p99jc\"" Jun 11 12:39:50.242588 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.242502 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 12:39:50.251955 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.251928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-xf568"] Jun 11 12:39:50.258267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.258245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj529\" (UniqueName: \"kubernetes.io/projected/0248c85b-e319-4195-af3a-d1603a2ad6f4-kube-api-access-pj529\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.258378 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.258275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0248c85b-e319-4195-af3a-d1603a2ad6f4-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.359311 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.359269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj529\" (UniqueName: \"kubernetes.io/projected/0248c85b-e319-4195-af3a-d1603a2ad6f4-kube-api-access-pj529\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.359311 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.359314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0248c85b-e319-4195-af3a-d1603a2ad6f4-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.360011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.359986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0248c85b-e319-4195-af3a-d1603a2ad6f4-redirect-config\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.368106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.368084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj529\" (UniqueName: \"kubernetes.io/projected/0248c85b-e319-4195-af3a-d1603a2ad6f4-kube-api-access-pj529\") pod \"dashboard-redirect-5ccf4c4b56-xf568\" (UID: \"0248c85b-e319-4195-af3a-d1603a2ad6f4\") " pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.549908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.549823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" Jun 11 12:39:50.691103 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:50.691080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ccf4c4b56-xf568"] Jun 11 12:39:50.693893 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:39:50.693864 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0248c85b_e319_4195_af3a_d1603a2ad6f4.slice/crio-79b59841b2790af5a76e83bec236905098a564dacb3eb85a8038b37d6ad85059 WatchSource:0}: Error finding container 79b59841b2790af5a76e83bec236905098a564dacb3eb85a8038b37d6ad85059: Status 404 returned error can't find the container with id 79b59841b2790af5a76e83bec236905098a564dacb3eb85a8038b37d6ad85059 Jun 11 12:39:51.469189 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:51.469145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" event={"ID":"0248c85b-e319-4195-af3a-d1603a2ad6f4","Type":"ContainerStarted","Data":"79b59841b2790af5a76e83bec236905098a564dacb3eb85a8038b37d6ad85059"} Jun 11 12:39:56.498318 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:56.498280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" event={"ID":"0248c85b-e319-4195-af3a-d1603a2ad6f4","Type":"ContainerStarted","Data":"0c7552c3cae57ef9b900860e5aa5905e81c7539ea9fd1524bd6a3663f46e8ee6"} Jun 11 12:39:56.519690 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:39:56.519643 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5ccf4c4b56-xf568" podStartSLOduration=1.341552188 podStartE2EDuration="6.519628373s" totalImagesPullingTime="5.178076185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:39:56.517540042 +0000 UTC m=+1143.815916544" watchObservedRunningTime="2026-06-11 12:39:56.519628373 +0000 UTC m=+1143.818004888" Jun 11 12:40:15.173651 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.173617 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb"] Jun 11 12:40:15.182740 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.182719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.185915 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.185889 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 12:40:15.186038 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.185924 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-svtlk\"" Jun 11 12:40:15.186038 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.185902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 12:40:15.186038 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.185902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 12:40:15.191512 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.191487 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb"] Jun 11 12:40:15.286920 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.286886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.286920 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.286918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25205a87-8236-4455-8f14-b5c9c411fb43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287109 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.286945 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287109 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287109 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287109 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvht7\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-kube-api-access-rvht7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.287267 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.287180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25205a87-8236-4455-8f14-b5c9c411fb43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388372 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388372 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvht7\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-kube-api-access-rvht7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25205a87-8236-4455-8f14-b5c9c411fb43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25205a87-8236-4455-8f14-b5c9c411fb43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388964 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388964 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388964 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.388964 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.388916 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.389160 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.389047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.389298 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.389278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25205a87-8236-4455-8f14-b5c9c411fb43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.390863 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.390841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25205a87-8236-4455-8f14-b5c9c411fb43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.391102 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.391084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25205a87-8236-4455-8f14-b5c9c411fb43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.397157 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.397133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.397270 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.397241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvht7\" (UniqueName: \"kubernetes.io/projected/25205a87-8236-4455-8f14-b5c9c411fb43-kube-api-access-rvht7\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsm2lb\" (UID: \"25205a87-8236-4455-8f14-b5c9c411fb43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.494296 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.494200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:15.640447 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:15.640312 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb"] Jun 11 12:40:15.642693 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:40:15.642667 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25205a87_8236_4455_8f14_b5c9c411fb43.slice/crio-b1dae2448d54802e4f6d0f22787f67c38f4a02e09ecdd3405c794982ac1b5d6f WatchSource:0}: Error finding container b1dae2448d54802e4f6d0f22787f67c38f4a02e09ecdd3405c794982ac1b5d6f: Status 404 returned error can't find the container with id b1dae2448d54802e4f6d0f22787f67c38f4a02e09ecdd3405c794982ac1b5d6f Jun 11 12:40:16.595881 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:16.595845 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" event={"ID":"25205a87-8236-4455-8f14-b5c9c411fb43","Type":"ContainerStarted","Data":"b1dae2448d54802e4f6d0f22787f67c38f4a02e09ecdd3405c794982ac1b5d6f"} Jun 11 12:40:20.934868 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.934830 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:20.938654 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.938628 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:20.941415 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.941391 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 12:40:20.942476 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.942444 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 12:40:20.942476 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.942452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zqkbb\"" Jun 11 12:40:20.949929 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:20.949869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:21.042563 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.042524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbjg2\" (UniqueName: \"kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2\") pod \"kuadrant-operator-catalog-2rzsr\" (UID: \"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f\") " pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:21.143574 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.143535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbjg2\" (UniqueName: \"kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2\") pod \"kuadrant-operator-catalog-2rzsr\" (UID: \"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f\") " pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:21.151573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.151541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbjg2\" (UniqueName: \"kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2\") pod \"kuadrant-operator-catalog-2rzsr\" (UID: \"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f\") " pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:21.251813 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.251736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:21.298689 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.298657 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:21.394990 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.394966 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:21.397076 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:40:21.397054 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e60d13_9e42_4dff_ac9f_9b4edb3b1c0f.slice/crio-1c9be810dabca2a35dc8080758aefb799dddedc960178cb5816436a5ee63d173 WatchSource:0}: Error finding container 1c9be810dabca2a35dc8080758aefb799dddedc960178cb5816436a5ee63d173: Status 404 returned error can't find the container with id 1c9be810dabca2a35dc8080758aefb799dddedc960178cb5816436a5ee63d173 Jun 11 12:40:21.511791 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.511710 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gj66w"] Jun 11 12:40:21.517295 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.517272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:21.522546 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.522519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gj66w"] Jun 11 12:40:21.620335 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.620295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" event={"ID":"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f","Type":"ContainerStarted","Data":"1c9be810dabca2a35dc8080758aefb799dddedc960178cb5816436a5ee63d173"} Jun 11 12:40:21.649944 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.649908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5kz\" (UniqueName: \"kubernetes.io/projected/127f108b-63f1-4fb7-8152-80d64dba99a8-kube-api-access-bb5kz\") pod \"kuadrant-operator-catalog-gj66w\" (UID: \"127f108b-63f1-4fb7-8152-80d64dba99a8\") " pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:21.750925 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.750883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5kz\" (UniqueName: \"kubernetes.io/projected/127f108b-63f1-4fb7-8152-80d64dba99a8-kube-api-access-bb5kz\") pod \"kuadrant-operator-catalog-gj66w\" (UID: \"127f108b-63f1-4fb7-8152-80d64dba99a8\") " pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:21.759455 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.759426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5kz\" (UniqueName: \"kubernetes.io/projected/127f108b-63f1-4fb7-8152-80d64dba99a8-kube-api-access-bb5kz\") pod \"kuadrant-operator-catalog-gj66w\" (UID: \"127f108b-63f1-4fb7-8152-80d64dba99a8\") " pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:21.830461 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:21.830375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:22.467972 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.467935 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:40:22.468345 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.468008 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:40:22.468345 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.468037 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:40:22.533445 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.533358 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gj66w"] Jun 11 12:40:22.535590 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:40:22.535538 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127f108b_63f1_4fb7_8152_80d64dba99a8.slice/crio-e47c44d5409f913d533e858009cd2b517dcff362732cce87dfb158f82ed4f0f1 WatchSource:0}: Error finding container e47c44d5409f913d533e858009cd2b517dcff362732cce87dfb158f82ed4f0f1: Status 404 returned error can't find the container with id e47c44d5409f913d533e858009cd2b517dcff362732cce87dfb158f82ed4f0f1 Jun 11 12:40:22.627528 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.627483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" event={"ID":"25205a87-8236-4455-8f14-b5c9c411fb43","Type":"ContainerStarted","Data":"ba091e54a0845bd784160f82bda91ba4dcc16274fbfe1993fb1d133701e9304b"} Jun 11 12:40:22.629275 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.629242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" event={"ID":"127f108b-63f1-4fb7-8152-80d64dba99a8","Type":"ContainerStarted","Data":"e47c44d5409f913d533e858009cd2b517dcff362732cce87dfb158f82ed4f0f1"} Jun 11 12:40:22.660383 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:22.660292 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" podStartSLOduration=0.837406475 podStartE2EDuration="7.660274685s" totalImagesPullingTime="6.82286821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:22.658896932 +0000 UTC m=+1169.957273436" watchObservedRunningTime="2026-06-11 12:40:22.660274685 +0000 UTC m=+1169.958651188" Jun 11 12:40:23.494968 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:23.494934 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:23.499803 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:23.499779 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:23.636659 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:23.636628 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:23.637605 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:23.637575 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsm2lb" Jun 11 12:40:24.642958 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:24.642924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" event={"ID":"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f","Type":"ContainerStarted","Data":"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f"} Jun 11 12:40:24.643446 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:24.642967 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" podUID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" containerName="registry-server" containerID="cri-o://a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f" gracePeriod=2 Jun 11 12:40:24.645080 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:24.645048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" event={"ID":"127f108b-63f1-4fb7-8152-80d64dba99a8","Type":"ContainerStarted","Data":"040858397e5bbc4e4816b7fd5d6c11d39f7fec63c3c4607bc200470fc02a5978"} Jun 11 12:40:24.660872 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:24.660826 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" podStartSLOduration=1.578918761 podStartE2EDuration="4.660810686s" totalImagesPullingTime="3.081891925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:24.659587256 +0000 UTC m=+1171.957963759" watchObservedRunningTime="2026-06-11 12:40:24.660810686 +0000 UTC m=+1171.959187187" Jun 11 12:40:24.675800 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:24.675754 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" podStartSLOduration=1.728977788 podStartE2EDuration="3.675739138s" totalImagesPullingTime="1.94676135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:24.674509619 +0000 UTC m=+1171.972886120" watchObservedRunningTime="2026-06-11 12:40:24.675739138 +0000 UTC m=+1171.974115651" Jun 11 12:40:25.034200 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.034171 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:25.088463 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.088384 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbjg2\" (UniqueName: \"kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2\") pod \"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f\" (UID: \"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f\") " Jun 11 12:40:25.090474 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.090446 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2" (OuterVolumeSpecName: "kube-api-access-xbjg2") pod "98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" (UID: "98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f"). InnerVolumeSpecName "kube-api-access-xbjg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:40:25.188973 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.188939 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbjg2\" (UniqueName: \"kubernetes.io/projected/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f-kube-api-access-xbjg2\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:40:25.651485 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.651453 2559 generic.go:356] "Generic (PLEG): container finished" podID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" containerID="a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f" exitCode=0 Jun 11 12:40:25.651946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.651498 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" Jun 11 12:40:25.651946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.651538 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" event={"ID":"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f","Type":"ContainerDied","Data":"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f"} Jun 11 12:40:25.651946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.651596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2rzsr" event={"ID":"98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f","Type":"ContainerDied","Data":"1c9be810dabca2a35dc8080758aefb799dddedc960178cb5816436a5ee63d173"} Jun 11 12:40:25.651946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.651630 2559 scope.go:117] "RemoveContainer" containerID="a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f" Jun 11 12:40:25.660600 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.660586 2559 scope.go:117] "RemoveContainer" containerID="a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f" Jun 11 12:40:25.660837 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:40:25.660821 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f\": container with ID starting with a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f not found: ID does not exist" containerID="a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f" Jun 11 12:40:25.660886 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.660844 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f"} err="failed to get container status \"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f\": rpc error: code = NotFound desc = could not find container \"a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f\": container with ID starting with a10147d895c23b378556dc7f87d770107f8d3254d8d1674b769770b97814d23f not found: ID does not exist" Jun 11 12:40:25.672494 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.672472 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:25.677194 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:25.677173 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2rzsr"] Jun 11 12:40:27.088840 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:27.088806 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" path="/var/lib/kubelet/pods/98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f/volumes" Jun 11 12:40:31.830921 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:31.830883 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:31.831365 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:31.830945 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:31.853642 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:31.853615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:32.704547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:32.704522 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gj66w" Jun 11 12:40:52.259506 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.259467 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx"] Jun 11 12:40:52.259998 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.259833 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" containerName="registry-server" Jun 11 12:40:52.259998 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.259844 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" containerName="registry-server" Jun 11 12:40:52.259998 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.259903 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e60d13-9e42-4dff-ac9f-9b4edb3b1c0f" containerName="registry-server" Jun 11 12:40:52.265430 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.265412 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:52.268700 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.268682 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pv5bh\"" Jun 11 12:40:52.268810 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.268686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 12:40:52.278630 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.278606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx"] Jun 11 12:40:52.441062 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.441029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4td\" (UniqueName: \"kubernetes.io/projected/4e943e21-4324-4cde-9be3-8a0dab954215-kube-api-access-kj4td\") pod \"dns-operator-controller-manager-864dd78c4c-gnqrx\" (UID: \"4e943e21-4324-4cde-9be3-8a0dab954215\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:52.542189 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.542107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4td\" (UniqueName: \"kubernetes.io/projected/4e943e21-4324-4cde-9be3-8a0dab954215-kube-api-access-kj4td\") pod \"dns-operator-controller-manager-864dd78c4c-gnqrx\" (UID: \"4e943e21-4324-4cde-9be3-8a0dab954215\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:52.555014 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.554982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4td\" (UniqueName: \"kubernetes.io/projected/4e943e21-4324-4cde-9be3-8a0dab954215-kube-api-access-kj4td\") pod \"dns-operator-controller-manager-864dd78c4c-gnqrx\" (UID: \"4e943e21-4324-4cde-9be3-8a0dab954215\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:52.575916 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.575892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:52.726681 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.726646 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx"] Jun 11 12:40:52.729994 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:40:52.729964 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e943e21_4324_4cde_9be3_8a0dab954215.slice/crio-f4ede7ea431a7c3aced58be2e9718d20c9e77916620410ac2541be6de483204b WatchSource:0}: Error finding container f4ede7ea431a7c3aced58be2e9718d20c9e77916620410ac2541be6de483204b: Status 404 returned error can't find the container with id f4ede7ea431a7c3aced58be2e9718d20c9e77916620410ac2541be6de483204b Jun 11 12:40:52.776798 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:52.776765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" event={"ID":"4e943e21-4324-4cde-9be3-8a0dab954215","Type":"ContainerStarted","Data":"f4ede7ea431a7c3aced58be2e9718d20c9e77916620410ac2541be6de483204b"} Jun 11 12:40:53.161066 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:53.161039 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:40:53.163040 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:53.163023 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:40:55.489008 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:55.488982 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 12:40:55.793224 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:55.793108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" event={"ID":"4e943e21-4324-4cde-9be3-8a0dab954215","Type":"ContainerStarted","Data":"373a0e3b128207064875f0068aea92d51e1f72ed4955dfe815d8deee639f4dc7"} Jun 11 12:40:55.793224 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:55.793192 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:40:55.812330 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:55.812275 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" podStartSLOduration=1.058217587 podStartE2EDuration="3.812260519s" totalImagesPullingTime="2.754042932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:55.810737638 +0000 UTC m=+1203.109114143" watchObservedRunningTime="2026-06-11 12:40:55.812260519 +0000 UTC m=+1203.110637022" Jun 11 12:40:56.512677 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.512644 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn"] Jun 11 12:40:56.516254 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.516232 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:56.518768 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.518748 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-scg68\"" Jun 11 12:40:56.525617 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.525599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn"] Jun 11 12:40:56.683564 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.683534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m2rz\" (UniqueName: \"kubernetes.io/projected/e452884b-6d4e-4f79-8d6e-742253cea7f6-kube-api-access-5m2rz\") pod \"authorino-operator-75cc8d5cb7-5bwsn\" (UID: \"e452884b-6d4e-4f79-8d6e-742253cea7f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:56.784913 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.784834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m2rz\" (UniqueName: \"kubernetes.io/projected/e452884b-6d4e-4f79-8d6e-742253cea7f6-kube-api-access-5m2rz\") pod \"authorino-operator-75cc8d5cb7-5bwsn\" (UID: \"e452884b-6d4e-4f79-8d6e-742253cea7f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:56.794923 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.794887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m2rz\" (UniqueName: \"kubernetes.io/projected/e452884b-6d4e-4f79-8d6e-742253cea7f6-kube-api-access-5m2rz\") pod \"authorino-operator-75cc8d5cb7-5bwsn\" (UID: \"e452884b-6d4e-4f79-8d6e-742253cea7f6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:56.825911 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.825884 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:56.961233 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:56.961188 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn"] Jun 11 12:40:56.964497 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:40:56.964470 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode452884b_6d4e_4f79_8d6e_742253cea7f6.slice/crio-eee33780298e6d5e0b25f4a0ef48593127de5acd4186c4d8e0192f7bfa4d3b5e WatchSource:0}: Error finding container eee33780298e6d5e0b25f4a0ef48593127de5acd4186c4d8e0192f7bfa4d3b5e: Status 404 returned error can't find the container with id eee33780298e6d5e0b25f4a0ef48593127de5acd4186c4d8e0192f7bfa4d3b5e Jun 11 12:40:57.804574 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:57.804530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" event={"ID":"e452884b-6d4e-4f79-8d6e-742253cea7f6","Type":"ContainerStarted","Data":"eee33780298e6d5e0b25f4a0ef48593127de5acd4186c4d8e0192f7bfa4d3b5e"} Jun 11 12:40:59.625519 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.625436 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b"] Jun 11 12:40:59.629049 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.629032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:40:59.632082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.632061 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xbgtm\"" Jun 11 12:40:59.638331 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.638307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b"] Jun 11 12:40:59.712732 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.712697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wj6r\" (UniqueName: \"kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r\") pod \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" (UID: \"a1d7eeea-d1e7-4420-8f58-108724f1583e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:40:59.813881 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.813844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wj6r\" (UniqueName: \"kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r\") pod \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" (UID: \"a1d7eeea-d1e7-4420-8f58-108724f1583e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:40:59.816263 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.816236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" event={"ID":"e452884b-6d4e-4f79-8d6e-742253cea7f6","Type":"ContainerStarted","Data":"c1460965684b645de86eb99ecd75ab6c3b5e2b41b00792c70a59937ab1c597e9"} Jun 11 12:40:59.816409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.816332 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:40:59.828374 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.828353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wj6r\" (UniqueName: \"kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r\") pod \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" (UID: \"a1d7eeea-d1e7-4420-8f58-108724f1583e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:40:59.843481 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.843441 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" podStartSLOduration=1.65409746 podStartE2EDuration="3.843428614s" totalImagesPullingTime="2.189331154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:40:59.84161231 +0000 UTC m=+1207.139988813" watchObservedRunningTime="2026-06-11 12:40:59.843428614 +0000 UTC m=+1207.141805116" Jun 11 12:40:59.940152 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:40:59.940125 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:00.076682 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:00.076651 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b"] Jun 11 12:41:00.080007 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:41:00.079983 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d7eeea_d1e7_4420_8f58_108724f1583e.slice/crio-cb0d295b46ea708fec489bd22d796451d76659c561d32d34695f52468a431007 WatchSource:0}: Error finding container cb0d295b46ea708fec489bd22d796451d76659c561d32d34695f52468a431007: Status 404 returned error can't find the container with id cb0d295b46ea708fec489bd22d796451d76659c561d32d34695f52468a431007 Jun 11 12:41:00.824143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:00.824026 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" event={"ID":"a1d7eeea-d1e7-4420-8f58-108724f1583e","Type":"ContainerStarted","Data":"cb0d295b46ea708fec489bd22d796451d76659c561d32d34695f52468a431007"} Jun 11 12:41:02.835276 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:02.835242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" event={"ID":"a1d7eeea-d1e7-4420-8f58-108724f1583e","Type":"ContainerStarted","Data":"74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f"} Jun 11 12:41:02.835673 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:02.835333 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:02.862632 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:02.862579 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" podStartSLOduration=2.075737439 podStartE2EDuration="3.862564117s" totalImagesPullingTime="1.786826678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:02.860899716 +0000 UTC m=+1210.159276218" watchObservedRunningTime="2026-06-11 12:41:02.862564117 +0000 UTC m=+1210.160940619" Jun 11 12:41:06.800382 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:06.800346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gnqrx" Jun 11 12:41:10.826352 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:10.826323 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5bwsn" Jun 11 12:41:13.843092 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:13.843056 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:15.053409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.053372 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz"] Jun 11 12:41:15.057046 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.057029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.059832 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.059811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 12:41:15.059946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.059846 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 12:41:15.059946 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.059869 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2g7j7\"" Jun 11 12:41:15.065354 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.065333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz"] Jun 11 12:41:15.131394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.131364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.131568 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.131424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfq2v\" (UniqueName: \"kubernetes.io/projected/cd6a1600-c980-4ae4-933a-bb0866fd20fe-kube-api-access-lfq2v\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.131568 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.131451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd6a1600-c980-4ae4-933a-bb0866fd20fe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.232665 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.232621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfq2v\" (UniqueName: \"kubernetes.io/projected/cd6a1600-c980-4ae4-933a-bb0866fd20fe-kube-api-access-lfq2v\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.232665 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.232664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd6a1600-c980-4ae4-933a-bb0866fd20fe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.232877 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.232758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.232877 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:15.232863 2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 12:41:15.232950 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:15.232933 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert podName:cd6a1600-c980-4ae4-933a-bb0866fd20fe nodeName:}" failed. No retries permitted until 2026-06-11 12:41:15.732912138 +0000 UTC m=+1223.031288619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cv9pz" (UID: "cd6a1600-c980-4ae4-933a-bb0866fd20fe") : secret "plugin-serving-cert" not found Jun 11 12:41:15.233459 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.233441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd6a1600-c980-4ae4-933a-bb0866fd20fe-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.249272 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.249242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfq2v\" (UniqueName: \"kubernetes.io/projected/cd6a1600-c980-4ae4-933a-bb0866fd20fe-kube-api-access-lfq2v\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.737200 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.737159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.739597 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.739562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd6a1600-c980-4ae4-933a-bb0866fd20fe-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv9pz\" (UID: \"cd6a1600-c980-4ae4-933a-bb0866fd20fe\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:15.977603 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:15.977564 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" Jun 11 12:41:16.108427 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:16.108398 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz"] Jun 11 12:41:16.111088 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:41:16.111059 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd6a1600_c980_4ae4_933a_bb0866fd20fe.slice/crio-5190a5c422255f980654081b2cf11117af6a781c7122a0ca743712808ea33df7 WatchSource:0}: Error finding container 5190a5c422255f980654081b2cf11117af6a781c7122a0ca743712808ea33df7: Status 404 returned error can't find the container with id 5190a5c422255f980654081b2cf11117af6a781c7122a0ca743712808ea33df7 Jun 11 12:41:16.906518 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:16.906481 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" event={"ID":"cd6a1600-c980-4ae4-933a-bb0866fd20fe","Type":"ContainerStarted","Data":"5190a5c422255f980654081b2cf11117af6a781c7122a0ca743712808ea33df7"} Jun 11 12:41:24.239683 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.239649 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq"] Jun 11 12:41:24.246975 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.246947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.251012 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.250493 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4kfxn\"" Jun 11 12:41:24.259370 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.259342 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq"] Jun 11 12:41:24.324286 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.324246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.324477 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.324300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtbm6\" (UniqueName: \"kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.425839 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.425796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.425839 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.425853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtbm6\" (UniqueName: \"kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.426323 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.426268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.436491 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.436462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtbm6\" (UniqueName: \"kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.567236 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.567128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:24.977676 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.977644 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq"] Jun 11 12:41:24.990389 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:24.990361 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq"] Jun 11 12:41:25.029777 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.029740 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:41:25.036757 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.036726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.040899 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.040873 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b"] Jun 11 12:41:25.041101 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.041067 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" containerName="manager" containerID="cri-o://74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f" gracePeriod=2 Jun 11 12:41:25.048983 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.048957 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b"] Jun 11 12:41:25.097681 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:25.097631 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:25.134383 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.134321 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.134383 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.134380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcwz\" (UniqueName: \"kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.230515 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.230400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:41:25.235957 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.235930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.236123 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.235982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcwz\" (UniqueName: \"kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.236485 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.236454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.253596 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.253568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcwz\" (UniqueName: \"kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fz6m5\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:25.352353 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:25.352318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:38.226318 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:38.226297 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:38.228727 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:38.228703 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:38.235176 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:38.235155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:41:38.235851 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:41:38.235829 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafdcd5f8_e899_4876_b0b3_6369be3e3355.slice/crio-4f7e183592e6c5a1c3b4e157eb1628fccf15ba512df9115ae414bf7f860125f4 WatchSource:0}: Error finding container 4f7e183592e6c5a1c3b4e157eb1628fccf15ba512df9115ae414bf7f860125f4: Status 404 returned error can't find the container with id 4f7e183592e6c5a1c3b4e157eb1628fccf15ba512df9115ae414bf7f860125f4 Jun 11 12:41:38.369972 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:38.369886 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wj6r\" (UniqueName: \"kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r\") pod \"a1d7eeea-d1e7-4420-8f58-108724f1583e\" (UID: \"a1d7eeea-d1e7-4420-8f58-108724f1583e\") " Jun 11 12:41:38.371911 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:38.371890 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r" (OuterVolumeSpecName: "kube-api-access-4wj6r") pod "a1d7eeea-d1e7-4420-8f58-108724f1583e" (UID: "a1d7eeea-d1e7-4420-8f58-108724f1583e"). InnerVolumeSpecName "kube-api-access-4wj6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:41:38.471502 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:38.471476 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wj6r\" (UniqueName: \"kubernetes.io/projected/a1d7eeea-d1e7-4420-8f58-108724f1583e-kube-api-access-4wj6r\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:41:39.035720 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.035676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" event={"ID":"afdcd5f8-e899-4876-b0b3-6369be3e3355","Type":"ContainerStarted","Data":"4f7e183592e6c5a1c3b4e157eb1628fccf15ba512df9115ae414bf7f860125f4"} Jun 11 12:41:39.037526 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.037489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" event={"ID":"cd6a1600-c980-4ae4-933a-bb0866fd20fe","Type":"ContainerStarted","Data":"6f308fad80cf17f567e5e9e8a520eb738a34b10552495449b83ae93f6c2d63a6"} Jun 11 12:41:39.039178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.039148 2559 generic.go:356] "Generic (PLEG): container finished" podID="a1d7eeea-d1e7-4420-8f58-108724f1583e" containerID="74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f" exitCode=0 Jun 11 12:41:39.039341 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.039187 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:39.039341 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.039231 2559 scope.go:117] "RemoveContainer" containerID="74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f" Jun 11 12:41:39.049780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.049755 2559 scope.go:117] "RemoveContainer" containerID="74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f" Jun 11 12:41:39.050129 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:39.050102 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f\": container with ID starting with 74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f not found: ID does not exist" containerID="74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f" Jun 11 12:41:39.050190 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.050142 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f"} err="failed to get container status \"74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f\": rpc error: code = NotFound desc = could not find container \"74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f\": container with ID starting with 74f4ad6761df0e1003ddffff0212a1bac1f3c7ec84871b850810f81f387e179f not found: ID does not exist" Jun 11 12:41:39.078335 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.078291 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv9pz" podStartSLOduration=2.014533499 podStartE2EDuration="24.078275806s" totalImagesPullingTime="22.063742307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:39.077771203 +0000 UTC m=+1246.376147704" watchObservedRunningTime="2026-06-11 12:41:39.078275806 +0000 UTC m=+1246.376652308" Jun 11 12:41:39.080495 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:39.080461 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:39.082982 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:39.082958 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8cg6b\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8cg6b" Jun 11 12:41:39.090828 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:39.090807 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" path="/var/lib/kubelet/pods/a1d7eeea-d1e7-4420-8f58-108724f1583e/volumes" Jun 11 12:41:40.634525 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:40.634473 2559 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-r65rq_kuadrant-system_f84e0cc8-fe2f-4186-8345-a002fa25308f_0(92254ead41d3801e48d2718a911622fc5485d511694822a126f1940e792ef32c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-r65rq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 11 12:41:40.634866 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:40.634552 2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-r65rq_kuadrant-system_f84e0cc8-fe2f-4186-8345-a002fa25308f_0(92254ead41d3801e48d2718a911622fc5485d511694822a126f1940e792ef32c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-r65rq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:41.053514 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.053483 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:41.055898 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:41.055864 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:41.063089 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.063066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:41.065914 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:41.065886 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:41.198993 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.198945 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtbm6\" (UniqueName: \"kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6\") pod \"f84e0cc8-fe2f-4186-8345-a002fa25308f\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " Jun 11 12:41:41.199166 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.199051 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume\") pod \"f84e0cc8-fe2f-4186-8345-a002fa25308f\" (UID: \"f84e0cc8-fe2f-4186-8345-a002fa25308f\") " Jun 11 12:41:41.199357 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.199332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f84e0cc8-fe2f-4186-8345-a002fa25308f" (UID: "f84e0cc8-fe2f-4186-8345-a002fa25308f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:41:41.201143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.201113 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6" (OuterVolumeSpecName: "kube-api-access-gtbm6") pod "f84e0cc8-fe2f-4186-8345-a002fa25308f" (UID: "f84e0cc8-fe2f-4186-8345-a002fa25308f"). InnerVolumeSpecName "kube-api-access-gtbm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:41:41.300705 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.300669 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtbm6\" (UniqueName: \"kubernetes.io/projected/f84e0cc8-fe2f-4186-8345-a002fa25308f-kube-api-access-gtbm6\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:41:41.300705 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:41.300698 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f84e0cc8-fe2f-4186-8345-a002fa25308f-extensions-socket-volume\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:41:42.059475 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:42.059395 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:42.061820 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:42.061786 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:42.068548 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:42.068516 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:43.065764 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:43.065729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" event={"ID":"afdcd5f8-e899-4876-b0b3-6369be3e3355","Type":"ContainerStarted","Data":"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe"} Jun 11 12:41:43.066159 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:43.065827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:41:43.089220 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:43.089184 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" path="/var/lib/kubelet/pods/f84e0cc8-fe2f-4186-8345-a002fa25308f/volumes" Jun 11 12:41:43.090795 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:41:43.090762 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r65rq\" is forbidden: User \"system:node:ip-10-0-141-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-209.ec2.internal' and this object" podUID="f84e0cc8-fe2f-4186-8345-a002fa25308f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r65rq" Jun 11 12:41:43.090903 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:43.090837 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" podStartSLOduration=14.732161136 podStartE2EDuration="19.090821629s" totalImagesPullingTime="4.358660493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:41:43.088445021 +0000 UTC m=+1250.386821534" watchObservedRunningTime="2026-06-11 12:41:43.090821629 +0000 UTC m=+1250.389198131" Jun 11 12:41:54.074511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:41:54.074474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:42:06.636068 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:06.636036 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:42:06.636611 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:06.636257 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" podUID="afdcd5f8-e899-4876-b0b3-6369be3e3355" containerName="manager" containerID="cri-o://ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe" gracePeriod=10 Jun 11 12:42:06.952575 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:06.952552 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:42:07.042624 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.042587 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tcwz\" (UniqueName: \"kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz\") pod \"afdcd5f8-e899-4876-b0b3-6369be3e3355\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " Jun 11 12:42:07.042809 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.042722 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume\") pod \"afdcd5f8-e899-4876-b0b3-6369be3e3355\" (UID: \"afdcd5f8-e899-4876-b0b3-6369be3e3355\") " Jun 11 12:42:07.043097 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.043070 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "afdcd5f8-e899-4876-b0b3-6369be3e3355" (UID: "afdcd5f8-e899-4876-b0b3-6369be3e3355"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:42:07.045039 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.045006 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz" (OuterVolumeSpecName: "kube-api-access-7tcwz") pod "afdcd5f8-e899-4876-b0b3-6369be3e3355" (UID: "afdcd5f8-e899-4876-b0b3-6369be3e3355"). InnerVolumeSpecName "kube-api-access-7tcwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:42:07.143842 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.143809 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tcwz\" (UniqueName: \"kubernetes.io/projected/afdcd5f8-e899-4876-b0b3-6369be3e3355-kube-api-access-7tcwz\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:42:07.143842 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.143835 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afdcd5f8-e899-4876-b0b3-6369be3e3355-extensions-socket-volume\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:42:07.184329 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.184257 2559 generic.go:356] "Generic (PLEG): container finished" podID="afdcd5f8-e899-4876-b0b3-6369be3e3355" containerID="ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe" exitCode=0 Jun 11 12:42:07.184329 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.184315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" event={"ID":"afdcd5f8-e899-4876-b0b3-6369be3e3355","Type":"ContainerDied","Data":"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe"} Jun 11 12:42:07.184478 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.184355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" event={"ID":"afdcd5f8-e899-4876-b0b3-6369be3e3355","Type":"ContainerDied","Data":"4f7e183592e6c5a1c3b4e157eb1628fccf15ba512df9115ae414bf7f860125f4"} Jun 11 12:42:07.184478 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.184376 2559 scope.go:117] "RemoveContainer" containerID="ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe" Jun 11 12:42:07.184478 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.184320 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5" Jun 11 12:42:07.193175 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.193151 2559 scope.go:117] "RemoveContainer" containerID="ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe" Jun 11 12:42:07.193459 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:42:07.193439 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe\": container with ID starting with ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe not found: ID does not exist" containerID="ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe" Jun 11 12:42:07.193562 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.193466 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe"} err="failed to get container status \"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe\": rpc error: code = NotFound desc = could not find container \"ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe\": container with ID starting with ab0fe29d2d979d4e7b5aad2d932fdb68e5d4129c5f3bb6de9dc171d28416d5fe not found: ID does not exist" Jun 11 12:42:07.220846 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.220821 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:42:07.234428 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:07.234408 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fz6m5"] Jun 11 12:42:09.089814 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:09.089774 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afdcd5f8-e899-4876-b0b3-6369be3e3355" path="/var/lib/kubelet/pods/afdcd5f8-e899-4876-b0b3-6369be3e3355/volumes" Jun 11 12:42:10.456071 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456039 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl"] Jun 11 12:42:10.456444 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456430 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afdcd5f8-e899-4876-b0b3-6369be3e3355" containerName="manager" Jun 11 12:42:10.456444 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456442 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="afdcd5f8-e899-4876-b0b3-6369be3e3355" containerName="manager" Jun 11 12:42:10.456515 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456451 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" containerName="manager" Jun 11 12:42:10.456515 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456457 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" containerName="manager" Jun 11 12:42:10.456573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456541 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d7eeea-d1e7-4420-8f58-108724f1583e" containerName="manager" Jun 11 12:42:10.456573 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.456548 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="afdcd5f8-e899-4876-b0b3-6369be3e3355" containerName="manager" Jun 11 12:42:10.466270 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.466250 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.469383 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.469356 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p9qmg\"" Jun 11 12:42:10.470684 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.470637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl"] Jun 11 12:42:10.576538 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576538 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576796 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.576908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.577008 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.576938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8q8\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-kube-api-access-rv8q8\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8q8\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-kube-api-access-rv8q8\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678619 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678619 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678619 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678759 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678909 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678909 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.678909 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.678901 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.679110 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.679088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.679164 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.679130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.679347 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.679326 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.680713 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.680695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.681058 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.681042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.692087 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.692051 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.693374 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.693356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8q8\" (UniqueName: \"kubernetes.io/projected/0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8-kube-api-access-rv8q8\") pod \"maas-default-gateway-openshift-default-8559cd5744-nvcgl\" (UID: \"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.778477 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.778398 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:10.923247 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.923201 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl"] Jun 11 12:42:10.925455 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:42:10.925433 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed6b4ef_f74f_4e2a_bb44_f143b1ff61d8.slice/crio-c97214070133737685e9adc3584d683dae0dce61a007a6ac01a0a89e6472327f WatchSource:0}: Error finding container c97214070133737685e9adc3584d683dae0dce61a007a6ac01a0a89e6472327f: Status 404 returned error can't find the container with id c97214070133737685e9adc3584d683dae0dce61a007a6ac01a0a89e6472327f Jun 11 12:42:10.927364 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.927336 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:42:10.927423 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.927393 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:42:10.927458 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:10.927426 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:42:11.206672 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:11.206631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" event={"ID":"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8","Type":"ContainerStarted","Data":"f8db7533ad364dafa7c1adfad62693f717b1f4f5c9bff1556ca0de71dc34b057"} Jun 11 12:42:11.206869 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:11.206725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" event={"ID":"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8","Type":"ContainerStarted","Data":"c97214070133737685e9adc3584d683dae0dce61a007a6ac01a0a89e6472327f"} Jun 11 12:42:11.232120 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:11.232072 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podStartSLOduration=1.232059018 podStartE2EDuration="1.232059018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:42:11.231142828 +0000 UTC m=+1278.529519330" watchObservedRunningTime="2026-06-11 12:42:11.232059018 +0000 UTC m=+1278.530435520" Jun 11 12:42:11.779148 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:11.779107 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:11.783862 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:11.783841 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:12.211542 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.211514 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:12.212549 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.212528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:42:12.327290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.327261 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:12.330932 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.330916 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.333826 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.333804 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 12:42:12.340271 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.340247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:12.421897 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.421864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:12.498431 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.498348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psr78\" (UniqueName: \"kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.498580 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.498440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.598973 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.598942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.599166 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.599004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psr78\" (UniqueName: \"kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.599698 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.599675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.607763 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.607736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psr78\" (UniqueName: \"kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78\") pod \"limitador-limitador-64c94fd64f-xbq5w\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.642680 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.642654 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:12.697651 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.697624 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:42:12.702419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.702189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.712506 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.712476 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:42:12.722227 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.722190 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:42:12.800544 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.800462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/553b189b-abf9-495a-a2d1-1b39c2d7f974-config-file\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.800544 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.800538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b8k\" (UniqueName: \"kubernetes.io/projected/553b189b-abf9-495a-a2d1-1b39c2d7f974-kube-api-access-f7b8k\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.817997 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.817968 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:12.820173 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:42:12.820145 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46efcb75_d808_4657_9172_14b5abe6bfd9.slice/crio-41aeb107df3f47a3435c8d06b2d30f55a2891342f334432153c2bb21312cd1c8 WatchSource:0}: Error finding container 41aeb107df3f47a3435c8d06b2d30f55a2891342f334432153c2bb21312cd1c8: Status 404 returned error can't find the container with id 41aeb107df3f47a3435c8d06b2d30f55a2891342f334432153c2bb21312cd1c8 Jun 11 12:42:12.901119 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.901086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/553b189b-abf9-495a-a2d1-1b39c2d7f974-config-file\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.901298 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.901137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b8k\" (UniqueName: \"kubernetes.io/projected/553b189b-abf9-495a-a2d1-1b39c2d7f974-kube-api-access-f7b8k\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.901802 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.901782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/553b189b-abf9-495a-a2d1-1b39c2d7f974-config-file\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:12.910230 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:12.910186 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b8k\" (UniqueName: \"kubernetes.io/projected/553b189b-abf9-495a-a2d1-1b39c2d7f974-kube-api-access-f7b8k\") pod \"limitador-limitador-54d6d988d5-7q8zt\" (UID: \"553b189b-abf9-495a-a2d1-1b39c2d7f974\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:13.020811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:13.020777 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:13.189912 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:13.189884 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:42:13.192073 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:42:13.192044 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553b189b_abf9_495a_a2d1_1b39c2d7f974.slice/crio-48ed5e4a6f99ce78690640abe93278e239a12a833ba01f344226fb1d3c3299ae WatchSource:0}: Error finding container 48ed5e4a6f99ce78690640abe93278e239a12a833ba01f344226fb1d3c3299ae: Status 404 returned error can't find the container with id 48ed5e4a6f99ce78690640abe93278e239a12a833ba01f344226fb1d3c3299ae Jun 11 12:42:13.216838 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:13.216811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" event={"ID":"46efcb75-d808-4657-9172-14b5abe6bfd9","Type":"ContainerStarted","Data":"41aeb107df3f47a3435c8d06b2d30f55a2891342f334432153c2bb21312cd1c8"} Jun 11 12:42:13.217971 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:13.217943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" event={"ID":"553b189b-abf9-495a-a2d1-1b39c2d7f974","Type":"ContainerStarted","Data":"48ed5e4a6f99ce78690640abe93278e239a12a833ba01f344226fb1d3c3299ae"} Jun 11 12:42:16.240266 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.240147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" event={"ID":"46efcb75-d808-4657-9172-14b5abe6bfd9","Type":"ContainerStarted","Data":"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01"} Jun 11 12:42:16.240694 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.240319 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:16.241725 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.241693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" event={"ID":"553b189b-abf9-495a-a2d1-1b39c2d7f974","Type":"ContainerStarted","Data":"eb687a7d1d7b6796c2198de74b1dd3b507e9b976ae1bec8795f7969a0d71f5a3"} Jun 11 12:42:16.241841 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.241750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:16.265051 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.265006 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" podStartSLOduration=1.18820856 podStartE2EDuration="4.264993226s" totalImagesPullingTime="3.076784666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:42:16.262797365 +0000 UTC m=+1283.561173867" watchObservedRunningTime="2026-06-11 12:42:16.264993226 +0000 UTC m=+1283.563369728" Jun 11 12:42:16.287285 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:16.287242 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" podStartSLOduration=1.575610671 podStartE2EDuration="4.287227741s" totalImagesPullingTime="2.71161707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:42:16.285813523 +0000 UTC m=+1283.584190025" watchObservedRunningTime="2026-06-11 12:42:16.287227741 +0000 UTC m=+1283.585604273" Jun 11 12:42:27.247818 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.247788 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7q8zt" Jun 11 12:42:27.248293 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.247855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:27.353244 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.353197 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:27.353418 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.353399 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" podUID="46efcb75-d808-4657-9172-14b5abe6bfd9" containerName="limitador" containerID="cri-o://52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01" gracePeriod=30 Jun 11 12:42:27.902137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.902113 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:27.935441 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.935358 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psr78\" (UniqueName: \"kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78\") pod \"46efcb75-d808-4657-9172-14b5abe6bfd9\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " Jun 11 12:42:27.935441 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.935389 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file\") pod \"46efcb75-d808-4657-9172-14b5abe6bfd9\" (UID: \"46efcb75-d808-4657-9172-14b5abe6bfd9\") " Jun 11 12:42:27.935774 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.935750 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file" (OuterVolumeSpecName: "config-file") pod "46efcb75-d808-4657-9172-14b5abe6bfd9" (UID: "46efcb75-d808-4657-9172-14b5abe6bfd9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:42:27.937537 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:27.937512 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78" (OuterVolumeSpecName: "kube-api-access-psr78") pod "46efcb75-d808-4657-9172-14b5abe6bfd9" (UID: "46efcb75-d808-4657-9172-14b5abe6bfd9"). InnerVolumeSpecName "kube-api-access-psr78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:42:28.036936 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.036893 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psr78\" (UniqueName: \"kubernetes.io/projected/46efcb75-d808-4657-9172-14b5abe6bfd9-kube-api-access-psr78\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:42:28.036936 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.036938 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/46efcb75-d808-4657-9172-14b5abe6bfd9-config-file\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:42:28.305627 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.305536 2559 generic.go:356] "Generic (PLEG): container finished" podID="46efcb75-d808-4657-9172-14b5abe6bfd9" containerID="52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01" exitCode=0 Jun 11 12:42:28.305627 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.305596 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" Jun 11 12:42:28.305627 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.305614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" event={"ID":"46efcb75-d808-4657-9172-14b5abe6bfd9","Type":"ContainerDied","Data":"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01"} Jun 11 12:42:28.306137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.305668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xbq5w" event={"ID":"46efcb75-d808-4657-9172-14b5abe6bfd9","Type":"ContainerDied","Data":"41aeb107df3f47a3435c8d06b2d30f55a2891342f334432153c2bb21312cd1c8"} Jun 11 12:42:28.306137 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.305689 2559 scope.go:117] "RemoveContainer" containerID="52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01" Jun 11 12:42:28.315049 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.315033 2559 scope.go:117] "RemoveContainer" containerID="52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01" Jun 11 12:42:28.315317 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:42:28.315300 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01\": container with ID starting with 52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01 not found: ID does not exist" containerID="52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01" Jun 11 12:42:28.315372 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.315325 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01"} err="failed to get container status \"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01\": rpc error: code = NotFound desc = could not find container \"52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01\": container with ID starting with 52a01306091733191ba00f5f426c2f6d43e01dad8f0a3a1bbdf7c3991ef12a01 not found: ID does not exist" Jun 11 12:42:28.329113 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.329088 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:28.335161 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:28.335137 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xbq5w"] Jun 11 12:42:29.089809 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:29.089775 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46efcb75-d808-4657-9172-14b5abe6bfd9" path="/var/lib/kubelet/pods/46efcb75-d808-4657-9172-14b5abe6bfd9/volumes" Jun 11 12:42:33.398616 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.398582 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-m2frb"] Jun 11 12:42:33.400102 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.400075 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46efcb75-d808-4657-9172-14b5abe6bfd9" containerName="limitador" Jun 11 12:42:33.400264 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.400251 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46efcb75-d808-4657-9172-14b5abe6bfd9" containerName="limitador" Jun 11 12:42:33.400568 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.400554 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46efcb75-d808-4657-9172-14b5abe6bfd9" containerName="limitador" Jun 11 12:42:33.408975 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.408945 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.411200 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.411173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-m2frb"] Jun 11 12:42:33.411446 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.411428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 12:42:33.490452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.490413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7661df65-e31a-42af-ae9d-df5ee88ed05e-data\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.490629 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.490562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msm7t\" (UniqueName: \"kubernetes.io/projected/7661df65-e31a-42af-ae9d-df5ee88ed05e-kube-api-access-msm7t\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.591575 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.591532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7661df65-e31a-42af-ae9d-df5ee88ed05e-data\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.591763 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.591656 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msm7t\" (UniqueName: \"kubernetes.io/projected/7661df65-e31a-42af-ae9d-df5ee88ed05e-kube-api-access-msm7t\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.591908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.591887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7661df65-e31a-42af-ae9d-df5ee88ed05e-data\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.600702 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.600677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msm7t\" (UniqueName: \"kubernetes.io/projected/7661df65-e31a-42af-ae9d-df5ee88ed05e-kube-api-access-msm7t\") pod \"postgres-69fb4594cf-m2frb\" (UID: \"7661df65-e31a-42af-ae9d-df5ee88ed05e\") " pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.719909 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.719800 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:33.862104 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:33.862081 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-m2frb"] Jun 11 12:42:33.864726 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:42:33.864697 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7661df65_e31a_42af_ae9d_df5ee88ed05e.slice/crio-d001404863cd83cb08692d5544bdc940291a3ae66c296b8002d5e987960dd55d WatchSource:0}: Error finding container d001404863cd83cb08692d5544bdc940291a3ae66c296b8002d5e987960dd55d: Status 404 returned error can't find the container with id d001404863cd83cb08692d5544bdc940291a3ae66c296b8002d5e987960dd55d Jun 11 12:42:34.336406 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:34.336373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-m2frb" event={"ID":"7661df65-e31a-42af-ae9d-df5ee88ed05e","Type":"ContainerStarted","Data":"d001404863cd83cb08692d5544bdc940291a3ae66c296b8002d5e987960dd55d"} Jun 11 12:42:39.363751 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:39.363715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-m2frb" event={"ID":"7661df65-e31a-42af-ae9d-df5ee88ed05e","Type":"ContainerStarted","Data":"c214f15bcfecd2059b016542b28a2b954a30f1260034106d748b17022efa518e"} Jun 11 12:42:39.364165 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:39.363790 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:42:39.381456 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:39.381404 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-m2frb" podStartSLOduration=1.858066803 podStartE2EDuration="6.381388396s" totalImagesPullingTime="4.523321593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:42:39.379703814 +0000 UTC m=+1306.678080317" watchObservedRunningTime="2026-06-11 12:42:39.381388396 +0000 UTC m=+1306.679764898" Jun 11 12:42:45.396934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:42:45.396904 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-m2frb" Jun 11 12:43:11.932811 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.932722 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:43:11.945236 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.945193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:11.945400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.945241 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:43:11.948145 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.948123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 12:43:11.948308 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.948249 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zdhh4\"" Jun 11 12:43:11.948308 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.948287 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 12:43:11.948430 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:11.948385 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 12:43:12.067032 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.066997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd5b5\" (UniqueName: \"kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5\") pod \"maas-keycloak-0\" (UID: \"37602898-3dea-49bf-9257-dd260a36451e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:12.167681 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.167646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd5b5\" (UniqueName: \"kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5\") pod \"maas-keycloak-0\" (UID: \"37602898-3dea-49bf-9257-dd260a36451e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:12.177396 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.177364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd5b5\" (UniqueName: \"kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5\") pod \"maas-keycloak-0\" (UID: \"37602898-3dea-49bf-9257-dd260a36451e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:12.256236 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.256132 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:12.391899 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.391875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:43:12.394178 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:43:12.394155 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37602898_3dea_49bf_9257_dd260a36451e.slice/crio-3bf17ce7d531473598ff4390fc8081844748004a6f599104556adfd4bb6b02b8 WatchSource:0}: Error finding container 3bf17ce7d531473598ff4390fc8081844748004a6f599104556adfd4bb6b02b8: Status 404 returned error can't find the container with id 3bf17ce7d531473598ff4390fc8081844748004a6f599104556adfd4bb6b02b8 Jun 11 12:43:12.529244 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:12.529143 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37602898-3dea-49bf-9257-dd260a36451e","Type":"ContainerStarted","Data":"3bf17ce7d531473598ff4390fc8081844748004a6f599104556adfd4bb6b02b8"} Jun 11 12:43:17.563264 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:17.563151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37602898-3dea-49bf-9257-dd260a36451e","Type":"ContainerStarted","Data":"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18"} Jun 11 12:43:17.584634 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:17.584584 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.8439281680000001 podStartE2EDuration="6.584567282s" totalImagesPullingTime="4.740639114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:43:17.582950496 +0000 UTC m=+1344.881326998" watchObservedRunningTime="2026-06-11 12:43:17.584567282 +0000 UTC m=+1344.882944060" Jun 11 12:43:18.257097 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:18.257055 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:18.258889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:18.258857 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:19.257620 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:19.257566 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:20.256750 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:20.256688 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:21.257254 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:21.257176 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:22.256838 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:22.256792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:22.257273 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:22.257200 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:23.257078 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:23.257020 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:24.257290 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:24.257237 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:25.256552 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:25.256507 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:26.257133 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:26.257088 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:27.257018 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:27.256969 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:28.256868 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:28.256818 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:29.257283 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:29.257231 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 11 12:43:30.376684 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:30.376645 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 12:43:30.395336 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:30.395278 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:43:40.383785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:43:40.383752 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 12:44:19.840415 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.840378 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8tsts"] Jun 11 12:44:19.844019 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.844001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:19.846603 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.846583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9j4st\"" Jun 11 12:44:19.846710 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.846585 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 12:44:19.854511 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.854489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8tsts"] Jun 11 12:44:19.949215 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.949161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56fs\" (UniqueName: \"kubernetes.io/projected/d144c9f6-7121-4f68-9d45-0f31e1ab4a46-kube-api-access-t56fs\") pod \"payload-pre-processing-579785bc64-8tsts\" (UID: \"d144c9f6-7121-4f68-9d45-0f31e1ab4a46\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:19.958623 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:19.958583 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:44:20.050434 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.050401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56fs\" (UniqueName: \"kubernetes.io/projected/d144c9f6-7121-4f68-9d45-0f31e1ab4a46-kube-api-access-t56fs\") pod \"payload-pre-processing-579785bc64-8tsts\" (UID: \"d144c9f6-7121-4f68-9d45-0f31e1ab4a46\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:20.061047 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.061022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56fs\" (UniqueName: \"kubernetes.io/projected/d144c9f6-7121-4f68-9d45-0f31e1ab4a46-kube-api-access-t56fs\") pod \"payload-pre-processing-579785bc64-8tsts\" (UID: \"d144c9f6-7121-4f68-9d45-0f31e1ab4a46\") " pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:20.155508 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.155480 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:20.301445 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.301421 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-8tsts"] Jun 11 12:44:20.303174 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:44:20.303140 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd144c9f6_7121_4f68_9d45_0f31e1ab4a46.slice/crio-cb28aa799e639ecf0de963990ebfbf2885b00952fb34a7e0251c77e22fcf1fa1 WatchSource:0}: Error finding container cb28aa799e639ecf0de963990ebfbf2885b00952fb34a7e0251c77e22fcf1fa1: Status 404 returned error can't find the container with id cb28aa799e639ecf0de963990ebfbf2885b00952fb34a7e0251c77e22fcf1fa1 Jun 11 12:44:20.305125 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.305110 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:44:20.906987 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:20.906944 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" event={"ID":"d144c9f6-7121-4f68-9d45-0f31e1ab4a46","Type":"ContainerStarted","Data":"cb28aa799e639ecf0de963990ebfbf2885b00952fb34a7e0251c77e22fcf1fa1"} Jun 11 12:44:23.947504 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:23.947471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" event={"ID":"d144c9f6-7121-4f68-9d45-0f31e1ab4a46","Type":"ContainerStarted","Data":"17d357fab47d3ffb84fbf88a23d0eccd38d24966a3cecfad860d974570cb0b38"} Jun 11 12:44:23.947905 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:23.947869 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:44:23.965473 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:23.965414 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" podStartSLOduration=2.284912247 podStartE2EDuration="4.965397883s" totalImagesPullingTime="2.680485636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:44:23.963870675 +0000 UTC m=+1411.262247178" watchObservedRunningTime="2026-06-11 12:44:23.965397883 +0000 UTC m=+1411.263774385" Jun 11 12:44:27.491892 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.490716 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-nvcgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": read tcp 10.132.0.2:41234->10.132.0.37:15021: read: connection reset by peer" start-of-body= Jun 11 12:44:27.491892 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.490785 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podUID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": read tcp 10.132.0.2:41234->10.132.0.37:15021: read: connection reset by peer" Jun 11 12:44:27.969993 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.969958 2559 generic.go:356] "Generic (PLEG): container finished" podID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerID="f8db7533ad364dafa7c1adfad62693f717b1f4f5c9bff1556ca0de71dc34b057" exitCode=0 Jun 11 12:44:27.970176 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.970035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" event={"ID":"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8","Type":"ContainerDied","Data":"f8db7533ad364dafa7c1adfad62693f717b1f4f5c9bff1556ca0de71dc34b057"} Jun 11 12:44:27.970444 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.970431 2559 scope.go:117] "RemoveContainer" containerID="f8db7533ad364dafa7c1adfad62693f717b1f4f5c9bff1556ca0de71dc34b057" Jun 11 12:44:27.971422 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.971392 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:44:27.971496 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.971480 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:44:27.971547 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:27.971529 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 12:44:28.982188 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:28.982145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" event={"ID":"0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8","Type":"ContainerStarted","Data":"a32bb336c738920599222ee97f7fee5cb8913a466efe3702e537c2614f7b1636"} Jun 11 12:44:29.779085 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:29.779046 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:44:29.779320 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:29.779295 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-nvcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 12:44:29.779380 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:29.779348 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podUID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 12:44:30.779133 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:30.779095 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-nvcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 12:44:30.779543 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:30.779151 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podUID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 12:44:31.779541 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:31.779490 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-nvcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 12:44:31.779942 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:31.779559 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podUID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 12:44:32.779595 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:32.779562 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-nvcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 11 12:44:32.779986 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:32.779619 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" podUID="0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 11 12:44:33.782100 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:33.782072 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:44:33.782494 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:33.782462 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:44:33.783178 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:33.783160 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-nvcgl" Jun 11 12:44:34.956075 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:44:34.956046 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-8tsts" Jun 11 12:45:00.140131 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.140098 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686365-ndc8n"] Jun 11 12:45:00.143737 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.143720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:00.146333 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.146315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rdl8z\"" Jun 11 12:45:00.150016 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.149996 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686365-ndc8n"] Jun 11 12:45:00.230633 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.230592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xlk\" (UniqueName: \"kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk\") pod \"maas-api-key-cleanup-29686365-ndc8n\" (UID: \"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6\") " pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:00.331799 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.331764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xlk\" (UniqueName: \"kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk\") pod \"maas-api-key-cleanup-29686365-ndc8n\" (UID: \"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6\") " pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:00.340898 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.340862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xlk\" (UniqueName: \"kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk\") pod \"maas-api-key-cleanup-29686365-ndc8n\" (UID: \"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6\") " pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:00.455473 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.455386 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:00.593411 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:00.593388 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686365-ndc8n"] Jun 11 12:45:00.595336 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:45:00.595306 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1aca6d_5cca_428c_8ada_6af1fc3ef5d6.slice/crio-de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519 WatchSource:0}: Error finding container de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519: Status 404 returned error can't find the container with id de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519 Jun 11 12:45:01.145748 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:01.145704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" event={"ID":"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6","Type":"ContainerStarted","Data":"de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519"} Jun 11 12:45:04.171432 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:04.171398 2559 generic.go:356] "Generic (PLEG): container finished" podID="0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6" containerID="3d0751a47f4b2e5b16e23741c888cf3b4ab5300ee5552b81ab08f99d8e208a27" exitCode=0 Jun 11 12:45:04.171807 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:04.171465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" event={"ID":"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6","Type":"ContainerDied","Data":"3d0751a47f4b2e5b16e23741c888cf3b4ab5300ee5552b81ab08f99d8e208a27"} Jun 11 12:45:05.304370 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:05.304345 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:05.381798 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:05.381766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55xlk\" (UniqueName: \"kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk\") pod \"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6\" (UID: \"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6\") " Jun 11 12:45:05.383771 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:05.383744 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk" (OuterVolumeSpecName: "kube-api-access-55xlk") pod "0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6" (UID: "0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6"). InnerVolumeSpecName "kube-api-access-55xlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:45:05.482749 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:05.482678 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55xlk\" (UniqueName: \"kubernetes.io/projected/0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6-kube-api-access-55xlk\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:45:06.183011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:06.182983 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" Jun 11 12:45:06.183011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:06.183005 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686365-ndc8n" event={"ID":"0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6","Type":"ContainerDied","Data":"de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519"} Jun 11 12:45:06.183253 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:06.183051 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de61e78bf24489e78777d41167afc044e0da55c1f4b2528ed386be9d618da519" Jun 11 12:45:53.194828 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:53.194801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:45:53.198486 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:45:53.198463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4srhx_132a9350-7c1d-406f-82f6-ba47fd061d4b/ovn-acl-logging/0.log" Jun 11 12:46:32.582869 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:32.582787 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:32.583419 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:32.582980 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" containerID="cri-o://7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18" gracePeriod=30 Jun 11 12:46:34.629908 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.629881 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:34.636285 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.636258 2559 generic.go:356] "Generic (PLEG): container finished" podID="37602898-3dea-49bf-9257-dd260a36451e" containerID="7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18" exitCode=143 Jun 11 12:46:34.636400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.636298 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:34.636400 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.636327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37602898-3dea-49bf-9257-dd260a36451e","Type":"ContainerDied","Data":"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18"} Jun 11 12:46:34.636473 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.636402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37602898-3dea-49bf-9257-dd260a36451e","Type":"ContainerDied","Data":"3bf17ce7d531473598ff4390fc8081844748004a6f599104556adfd4bb6b02b8"} Jun 11 12:46:34.636473 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.636427 2559 scope.go:117] "RemoveContainer" containerID="7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18" Jun 11 12:46:34.649973 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.649953 2559 scope.go:117] "RemoveContainer" containerID="7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18" Jun 11 12:46:34.650329 ip-10-0-141-209 kubenswrapper[2559]: E0611 12:46:34.650303 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18\": container with ID starting with 7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18 not found: ID does not exist" containerID="7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18" Jun 11 12:46:34.650449 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.650334 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18"} err="failed to get container status \"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18\": rpc error: code = NotFound desc = could not find container \"7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18\": container with ID starting with 7dc9dc335ae5854431f73e4fcca389a7b801e1040864eafe5817db19a1e75d18 not found: ID does not exist" Jun 11 12:46:34.706510 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.706479 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd5b5\" (UniqueName: \"kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5\") pod \"37602898-3dea-49bf-9257-dd260a36451e\" (UID: \"37602898-3dea-49bf-9257-dd260a36451e\") " Jun 11 12:46:34.708554 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.708526 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5" (OuterVolumeSpecName: "kube-api-access-qd5b5") pod "37602898-3dea-49bf-9257-dd260a36451e" (UID: "37602898-3dea-49bf-9257-dd260a36451e"). InnerVolumeSpecName "kube-api-access-qd5b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:46:34.807444 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.807360 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd5b5\" (UniqueName: \"kubernetes.io/projected/37602898-3dea-49bf-9257-dd260a36451e-kube-api-access-qd5b5\") on node \"ip-10-0-141-209.ec2.internal\" DevicePath \"\"" Jun 11 12:46:34.962498 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.962471 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:34.966348 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.966325 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:34.995644 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.995619 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:34.996082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996063 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" Jun 11 12:46:34.996177 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996084 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" Jun 11 12:46:34.996177 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996120 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6" containerName="cleanup" Jun 11 12:46:34.996177 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996125 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6" containerName="cleanup" Jun 11 12:46:34.996329 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996191 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6" containerName="cleanup" Jun 11 12:46:34.996329 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:34.996203 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="37602898-3dea-49bf-9257-dd260a36451e" containerName="keycloak" Jun 11 12:46:35.000694 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.000678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.003714 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.003689 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 12:46:35.003714 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.003703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 12:46:35.003893 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.003708 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 12:46:35.003893 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.003755 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zdhh4\"" Jun 11 12:46:35.003893 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.003815 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 12:46:35.011277 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.011256 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:35.089922 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.089841 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37602898-3dea-49bf-9257-dd260a36451e" path="/var/lib/kubelet/pods/37602898-3dea-49bf-9257-dd260a36451e/volumes" Jun 11 12:46:35.110103 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.110073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d82bacb4-833b-4cd1-93ac-d3007b977321-test-realms\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.110282 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.110127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/d82bacb4-833b-4cd1-93ac-d3007b977321-kube-api-access-stfnp\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.210975 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.210938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d82bacb4-833b-4cd1-93ac-d3007b977321-test-realms\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.211143 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.210997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/d82bacb4-833b-4cd1-93ac-d3007b977321-kube-api-access-stfnp\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.211727 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.211709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d82bacb4-833b-4cd1-93ac-d3007b977321-test-realms\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.219721 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.219690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stfnp\" (UniqueName: \"kubernetes.io/projected/d82bacb4-833b-4cd1-93ac-d3007b977321-kube-api-access-stfnp\") pod \"maas-keycloak-0\" (UID: \"d82bacb4-833b-4cd1-93ac-d3007b977321\") " pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.311410 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.311374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:35.449429 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.449404 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 12:46:35.450924 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:46:35.450886 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82bacb4_833b_4cd1_93ac_d3007b977321.slice/crio-0615e85ef61331b422a7ea7ed42419440bc5ae46f4eefabf757e3dddc9d20762 WatchSource:0}: Error finding container 0615e85ef61331b422a7ea7ed42419440bc5ae46f4eefabf757e3dddc9d20762: Status 404 returned error can't find the container with id 0615e85ef61331b422a7ea7ed42419440bc5ae46f4eefabf757e3dddc9d20762 Jun 11 12:46:35.642452 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:35.642423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d82bacb4-833b-4cd1-93ac-d3007b977321","Type":"ContainerStarted","Data":"0615e85ef61331b422a7ea7ed42419440bc5ae46f4eefabf757e3dddc9d20762"} Jun 11 12:46:36.651393 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:36.651356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d82bacb4-833b-4cd1-93ac-d3007b977321","Type":"ContainerStarted","Data":"12850b62bd87f975bc83690e821050a5c463204ac723474388aee27a4798c6fa"} Jun 11 12:46:36.672362 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:36.672311 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.34517336 podStartE2EDuration="2.672294439s" totalImagesPullingTime="327.121079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:46:36.669457027 +0000 UTC m=+1543.967833541" watchObservedRunningTime="2026-06-11 12:46:36.672294439 +0000 UTC m=+1543.970670940" Jun 11 12:46:37.312589 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:37.312539 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:37.314315 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:37.314270 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:38.312845 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:38.312782 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:39.312355 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:39.312300 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:40.312775 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:40.312722 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:41.312775 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:41.312326 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:42.312283 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:42.312238 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:43.312063 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:43.312006 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:44.312030 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:44.311982 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:45.311922 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:45.311887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:45.312391 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:45.312353 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:46.311999 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:46.311940 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:47.311695 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:47.311650 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:48.311996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:48.311945 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.44:9000/health/started\": dial tcp 10.132.0.44:9000: connect: connection refused" Jun 11 12:46:49.413459 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:49.413416 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 12:46:49.428768 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:49.428710 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d82bacb4-833b-4cd1-93ac-d3007b977321" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:46:51.762082 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:51.762043 2559 generic.go:356] "Generic (PLEG): container finished" podID="80b2143e-ed29-46e3-abf6-7cf7a9c7fc17" containerID="0bb344bf4fec41c0a423ffca1e3d3452c68215b6957c2a39ba269b48e7d0b25a" exitCode=1 Jun 11 12:46:51.762658 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:51.762148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerDied","Data":"0bb344bf4fec41c0a423ffca1e3d3452c68215b6957c2a39ba269b48e7d0b25a"} Jun 11 12:46:51.762658 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:51.762612 2559 scope.go:117] "RemoveContainer" containerID="0bb344bf4fec41c0a423ffca1e3d3452c68215b6957c2a39ba269b48e7d0b25a" Jun 11 12:46:52.773172 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:52.773131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" event={"ID":"80b2143e-ed29-46e3-abf6-7cf7a9c7fc17","Type":"ContainerStarted","Data":"d223852648492deae09da7e56f0c93c1b29678c7bc02e53eb896ea80baedb9cf"} Jun 11 12:46:52.773710 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:52.773572 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:46:59.420632 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:46:59.420599 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 12:47:03.781873 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:03.781838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c94cd86bb-lt8gf" Jun 11 12:47:19.941106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:19.941074 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ccf4c4b56-xf568_0248c85b-e319-4195-af3a-d1603a2ad6f4/nginx/0.log" Jun 11 12:47:20.386977 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:20.386955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686365-ndc8n_0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6/cleanup/0.log" Jun 11 12:47:20.979780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:20.979748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-lt8gf_80b2143e-ed29-46e3-abf6-7cf7a9c7fc17/copy-manifests/0.log" Jun 11 12:47:20.988374 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:20.988353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-lt8gf_80b2143e-ed29-46e3-abf6-7cf7a9c7fc17/manager/1.log" Jun 11 12:47:21.223610 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:21.223580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-m2frb_7661df65-e31a-42af-ae9d-df5ee88ed05e/postgres/0.log" Jun 11 12:47:21.754799 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:21.754766 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:47:22.664199 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:22.664166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5bwsn_e452884b-6d4e-4f79-8d6e-742253cea7f6/manager/0.log" Jun 11 12:47:22.776996 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:22.776949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gnqrx_4e943e21-4324-4cde-9be3-8a0dab954215/manager/0.log" Jun 11 12:47:22.890612 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:22.890581 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cv9pz_cd6a1600-c980-4ae4-933a-bb0866fd20fe/kuadrant-console-plugin/0.log" Jun 11 12:47:23.004914 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:23.004832 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gj66w_127f108b-63f1-4fb7-8152-80d64dba99a8/registry-server/0.log" Jun 11 12:47:23.228520 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:23.228493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7q8zt_553b189b-abf9-495a-a2d1-1b39c2d7f974/limitador/0.log" Jun 11 12:47:23.700468 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:23.700439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsm2lb_25205a87-8236-4455-8f14-b5c9c411fb43/istio-proxy/0.log" Jun 11 12:47:24.181054 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:24.181020 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/1.log" Jun 11 12:47:24.786394 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:24.786336 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8tsts_d144c9f6-7121-4f68-9d45-0f31e1ab4a46/payload-pre-processing/0.log" Jun 11 12:47:32.584791 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:32.584758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xwqfn_a5202ad3-af7d-4193-92cb-c01fcf386854/global-pull-secret-syncer/0.log" Jun 11 12:47:32.691889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:32.691864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qmgwj_803d25bc-5008-4c23-a145-7ee8e0de0ca8/konnectivity-agent/0.log" Jun 11 12:47:32.812925 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:32.812898 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-209.ec2.internal_610d8524ad2ea70151f24165bbc26508/haproxy/0.log" Jun 11 12:47:37.072602 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:37.072572 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5bwsn_e452884b-6d4e-4f79-8d6e-742253cea7f6/manager/0.log" Jun 11 12:47:37.123507 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:37.123475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gnqrx_4e943e21-4324-4cde-9be3-8a0dab954215/manager/0.log" Jun 11 12:47:37.189843 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:37.189817 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cv9pz_cd6a1600-c980-4ae4-933a-bb0866fd20fe/kuadrant-console-plugin/0.log" Jun 11 12:47:37.235109 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:37.235030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gj66w_127f108b-63f1-4fb7-8152-80d64dba99a8/registry-server/0.log" Jun 11 12:47:37.336313 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:37.336285 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7q8zt_553b189b-abf9-495a-a2d1-1b39c2d7f974/limitador/0.log" Jun 11 12:47:39.057409 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.057357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/alertmanager/0.log" Jun 11 12:47:39.111761 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.111740 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/config-reloader/0.log" Jun 11 12:47:39.156115 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.156094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/kube-rbac-proxy-web/0.log" Jun 11 12:47:39.207129 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.207103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/kube-rbac-proxy/0.log" Jun 11 12:47:39.237249 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.237223 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/kube-rbac-proxy-metric/0.log" Jun 11 12:47:39.263261 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.263242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/prom-label-proxy/0.log" Jun 11 12:47:39.297067 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.297044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f1f4ab2-cf9e-4f32-98cb-2a131014be24/init-config-reloader/0.log" Jun 11 12:47:39.354785 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.354706 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-knv7m_4b018ed3-e104-4973-b6ea-f564dc0ea453/cluster-monitoring-operator/0.log" Jun 11 12:47:39.660736 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.660711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-sdvdf_09d1d311-3a5b-4626-8c97-7c73739e08ed/monitoring-plugin/0.log" Jun 11 12:47:39.738741 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.738712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/node-exporter/0.log" Jun 11 12:47:39.836955 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.836927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/kube-rbac-proxy/0.log" Jun 11 12:47:39.898987 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:39.898905 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djfbc_cecacd08-440e-4d5f-a7de-d497883320dd/init-textfile/0.log" Jun 11 12:47:40.472521 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.472438 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/prometheus/0.log" Jun 11 12:47:40.531410 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.531386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/config-reloader/0.log" Jun 11 12:47:40.605880 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.605855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/thanos-sidecar/0.log" Jun 11 12:47:40.744063 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.743977 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/kube-rbac-proxy-web/0.log" Jun 11 12:47:40.866497 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.866468 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/kube-rbac-proxy/0.log" Jun 11 12:47:40.905134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.905107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/kube-rbac-proxy-thanos/0.log" Jun 11 12:47:40.977029 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:40.976999 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c7ba4b9-0c6d-4c27-b8f0-63f04f40ec0d/init-config-reloader/0.log" Jun 11 12:47:41.127878 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.127794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gs8np_b4897df5-929b-43c6-a0c8-1de3a45a5c1a/prometheus-operator-admission-webhook/0.log" Jun 11 12:47:41.168253 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.168228 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/telemeter-client/0.log" Jun 11 12:47:41.202059 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.202034 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/reload/0.log" Jun 11 12:47:41.229240 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.229201 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b77c789b9-cmtfc_5a2f2782-eaca-41ae-a283-61a5daf0eb4e/kube-rbac-proxy/0.log" Jun 11 12:47:41.269083 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.269054 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/thanos-query/0.log" Jun 11 12:47:41.296545 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.296521 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/kube-rbac-proxy-web/0.log" Jun 11 12:47:41.324020 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.323997 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/kube-rbac-proxy/0.log" Jun 11 12:47:41.353353 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.353328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/prom-label-proxy/0.log" Jun 11 12:47:41.386637 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.386609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/kube-rbac-proxy-rules/0.log" Jun 11 12:47:41.426689 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:41.426666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbbf5954c-fd69h_a080fc83-643d-4687-9d72-659400393555/kube-rbac-proxy-metrics/0.log" Jun 11 12:47:42.683079 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.683049 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z"] Jun 11 12:47:42.686889 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.686870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.700587 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.700567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q577s\"/\"default-dockercfg-hkx79\"" Jun 11 12:47:42.700976 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.700958 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q577s\"/\"kube-root-ca.crt\"" Jun 11 12:47:42.701326 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.701309 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q577s\"/\"openshift-service-ca.crt\"" Jun 11 12:47:42.721331 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.721307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z"] Jun 11 12:47:42.764352 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.764331 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c5xz4_7d5164ae-085d-47cc-b0c5-0eecb75d5cbb/networking-console-plugin/0.log" Jun 11 12:47:42.798691 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.798663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t45\" (UniqueName: \"kubernetes.io/projected/9e11dae9-6ba7-455a-b560-9c7806cfebf9-kube-api-access-57t45\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.798824 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.798711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-proc\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.798824 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.798797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-sys\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.798824 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.798820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-lib-modules\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.798950 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.798839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-podres\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899540 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t45\" (UniqueName: \"kubernetes.io/projected/9e11dae9-6ba7-455a-b560-9c7806cfebf9-kube-api-access-57t45\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-proc\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-sys\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-lib-modules\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-podres\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-sys\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.899733 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-proc\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.900019 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-podres\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.900019 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.899774 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e11dae9-6ba7-455a-b560-9c7806cfebf9-lib-modules\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.913242 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.913198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t45\" (UniqueName: \"kubernetes.io/projected/9e11dae9-6ba7-455a-b560-9c7806cfebf9-kube-api-access-57t45\") pod \"perf-node-gather-daemonset-mbn6z\" (UID: \"9e11dae9-6ba7-455a-b560-9c7806cfebf9\") " pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:42.999684 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:42.999597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:43.164305 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.164270 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z"] Jun 11 12:47:43.169042 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:47:43.169012 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e11dae9_6ba7_455a_b560_9c7806cfebf9.slice/crio-82dcbeb959171fe750ef8f52da3b0da0994d07a756aa9430671067e9b52939ba WatchSource:0}: Error finding container 82dcbeb959171fe750ef8f52da3b0da0994d07a756aa9430671067e9b52939ba: Status 404 returned error can't find the container with id 82dcbeb959171fe750ef8f52da3b0da0994d07a756aa9430671067e9b52939ba Jun 11 12:47:43.452033 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.452000 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56"] Jun 11 12:47:43.455744 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.455720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.473484 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.473464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hfd94\"" Jun 11 12:47:43.474299 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.474275 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 12:47:43.474881 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.474863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 12:47:43.481073 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.481051 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 12:47:43.519952 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.519928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56"] Jun 11 12:47:43.607011 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.606979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.607237 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.607026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d8ae11-bff7-4ac4-a685-050347531c85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.607237 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.607053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.607237 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.607071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.607237 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.607184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nwnl\" (UniqueName: \"kubernetes.io/projected/09d8ae11-bff7-4ac4-a685-050347531c85-kube-api-access-6nwnl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.607492 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.607254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708343 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708343 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d8ae11-bff7-4ac4-a685-050347531c85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nwnl\" (UniqueName: \"kubernetes.io/projected/09d8ae11-bff7-4ac4-a685-050347531c85-kube-api-access-6nwnl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708717 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708813 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.708934 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.708881 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.710441 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.710417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09d8ae11-bff7-4ac4-a685-050347531c85-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.710810 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.710795 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09d8ae11-bff7-4ac4-a685-050347531c85-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.722782 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.722758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nwnl\" (UniqueName: \"kubernetes.io/projected/09d8ae11-bff7-4ac4-a685-050347531c85-kube-api-access-6nwnl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrm56\" (UID: \"09d8ae11-bff7-4ac4-a685-050347531c85\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.765961 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.765931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" Jun 11 12:47:43.935518 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:43.935493 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56"] Jun 11 12:47:43.937905 ip-10-0-141-209 kubenswrapper[2559]: W0611 12:47:43.937879 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d8ae11_bff7_4ac4_a685_050347531c85.slice/crio-8206bf25887310b65f7710f72ff7b55835b068b182240078d9d96bf367702a53 WatchSource:0}: Error finding container 8206bf25887310b65f7710f72ff7b55835b068b182240078d9d96bf367702a53: Status 404 returned error can't find the container with id 8206bf25887310b65f7710f72ff7b55835b068b182240078d9d96bf367702a53 Jun 11 12:47:44.054737 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.054638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" event={"ID":"9e11dae9-6ba7-455a-b560-9c7806cfebf9","Type":"ContainerStarted","Data":"355a03f54f7646fe699a41d76936931013efa224e8988836cb9343e75a644cad"} Jun 11 12:47:44.054737 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.054701 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" event={"ID":"9e11dae9-6ba7-455a-b560-9c7806cfebf9","Type":"ContainerStarted","Data":"82dcbeb959171fe750ef8f52da3b0da0994d07a756aa9430671067e9b52939ba"} Jun 11 12:47:44.055006 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.054819 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:44.055780 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.055761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" event={"ID":"09d8ae11-bff7-4ac4-a685-050347531c85","Type":"ContainerStarted","Data":"8206bf25887310b65f7710f72ff7b55835b068b182240078d9d96bf367702a53"} Jun 11 12:47:44.090854 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.090807 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" podStartSLOduration=2.090793346 podStartE2EDuration="2.090793346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:47:44.087913433 +0000 UTC m=+1611.386289935" watchObservedRunningTime="2026-06-11 12:47:44.090793346 +0000 UTC m=+1611.389169848" Jun 11 12:47:44.299814 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:44.299774 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:47:46.861567 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:46.861539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf2j_749d36cc-42b9-45e5-8142-b45dcb27f05f/dns/0.log" Jun 11 12:47:46.890561 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:46.890532 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf2j_749d36cc-42b9-45e5-8142-b45dcb27f05f/kube-rbac-proxy/0.log" Jun 11 12:47:46.922147 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:46.922112 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-69zsg_76f11c9b-915f-42d5-af54-b5b63509c584/dns-node-resolver/0.log" Jun 11 12:47:47.744088 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:47.744007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9d72r_d7feef61-f359-47fb-bcde-6fb39769cf6a/node-ca/0.log" Jun 11 12:47:48.081912 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:48.081827 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" event={"ID":"09d8ae11-bff7-4ac4-a685-050347531c85","Type":"ContainerStarted","Data":"3a251bbbe5273c527ae4eb212b49d3e9784724002d8bf329e4e24a433d8771ba"} Jun 11 12:47:48.999322 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:48.999288 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsm2lb_25205a87-8236-4455-8f14-b5c9c411fb43/istio-proxy/0.log" Jun 11 12:47:49.259457 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:49.259369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/1.log" Jun 11 12:47:49.259827 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:49.259594 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/0.log" Jun 11 12:47:49.304879 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:49.304854 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8tsts_d144c9f6-7121-4f68-9d45-0f31e1ab4a46/payload-pre-processing/0.log" Jun 11 12:47:50.073322 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:50.073294 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q577s/perf-node-gather-daemonset-mbn6z" Jun 11 12:47:50.313608 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:50.313577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59252_8c1a4ff3-4173-40a4-a0e5-162d7df22396/serve-healthcheck-canary/0.log" Jun 11 12:47:51.469412 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:51.469380 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r77sk_41c26904-9ef4-4837-8610-5b700bdf2ae3/insights-operator/0.log" Jun 11 12:47:51.478106 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:51.478082 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r77sk_41c26904-9ef4-4837-8610-5b700bdf2ae3/insights-operator/1.log" Jun 11 12:47:51.556763 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:51.556733 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chrfj_1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a/kube-rbac-proxy/0.log" Jun 11 12:47:51.639399 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:51.639374 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chrfj_1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a/exporter/0.log" Jun 11 12:47:51.729924 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:51.729895 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-chrfj_1cd7c98b-c0a4-40ca-a95e-5b7d6810aa8a/extractor/0.log" Jun 11 12:47:52.103569 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:52.103540 2559 generic.go:356] "Generic (PLEG): container finished" podID="09d8ae11-bff7-4ac4-a685-050347531c85" containerID="3a251bbbe5273c527ae4eb212b49d3e9784724002d8bf329e4e24a433d8771ba" exitCode=0 Jun 11 12:47:52.103709 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:52.103615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" event={"ID":"09d8ae11-bff7-4ac4-a685-050347531c85","Type":"ContainerDied","Data":"3a251bbbe5273c527ae4eb212b49d3e9784724002d8bf329e4e24a433d8771ba"} Jun 11 12:47:54.115738 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:54.115702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" event={"ID":"09d8ae11-bff7-4ac4-a685-050347531c85","Type":"ContainerStarted","Data":"f1570aad4e2dd297ce9b68177149d8632e44015b61531a07550b3ac9c63ad81f"} Jun 11 12:47:54.326607 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:54.326552 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrm56" podStartSLOduration=2.359944651 podStartE2EDuration="11.326535674s" totalImagesPullingTime="4.538092875s" totalInitContainerRuntime="4.428498148s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:47:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:47:54.326347349 +0000 UTC m=+1621.624723864" watchObservedRunningTime="2026-06-11 12:47:54.326535674 +0000 UTC m=+1621.624912175" Jun 11 12:47:56.705320 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:56.705285 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ccf4c4b56-xf568_0248c85b-e319-4195-af3a-d1603a2ad6f4/nginx/0.log" Jun 11 12:47:56.900253 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:56.900201 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686365-ndc8n_0e1aca6d-5cca-428c-8ada-6af1fc3ef5d6/cleanup/0.log" Jun 11 12:47:56.969451 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:56.969378 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsm2lb_25205a87-8236-4455-8f14-b5c9c411fb43/istio-proxy/0.log" Jun 11 12:47:57.173134 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.173108 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/1.log" Jun 11 12:47:57.173403 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.173386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/0.log" Jun 11 12:47:57.186085 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.186066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8tsts_d144c9f6-7121-4f68-9d45-0f31e1ab4a46/payload-pre-processing/0.log" Jun 11 12:47:57.323687 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.323611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-lt8gf_80b2143e-ed29-46e3-abf6-7cf7a9c7fc17/manager/1.log" Jun 11 12:47:57.345873 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.345845 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-lt8gf_80b2143e-ed29-46e3-abf6-7cf7a9c7fc17/manager/0.log" Jun 11 12:47:57.394991 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.394960 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c94cd86bb-lt8gf_80b2143e-ed29-46e3-abf6-7cf7a9c7fc17/copy-manifests/0.log" Jun 11 12:47:57.545120 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:57.545094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-m2frb_7661df65-e31a-42af-ae9d-df5ee88ed05e/postgres/0.log" Jun 11 12:47:58.383218 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:58.383177 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsm2lb_25205a87-8236-4455-8f14-b5c9c411fb43/istio-proxy/0.log" Jun 11 12:47:58.575737 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:58.575702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/1.log" Jun 11 12:47:58.576007 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:58.575992 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/0.log" Jun 11 12:47:58.589956 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:58.589927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8tsts_d144c9f6-7121-4f68-9d45-0f31e1ab4a46/payload-pre-processing/0.log" Jun 11 12:47:59.243898 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:59.243859 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-776fd58779-ktjgz_6ba6f43a-5c62-4415-905c-70c62edc4dfb/manager/0.log" Jun 11 12:47:59.622582 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:47:59.622504 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7q8zt"] Jun 11 12:48:00.375768 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:48:00.375680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsm2lb_25205a87-8236-4455-8f14-b5c9c411fb43/istio-proxy/0.log" Jun 11 12:48:00.471423 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:48:00.471390 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/1.log" Jun 11 12:48:00.471848 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:48:00.471829 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-nvcgl_0ed6b4ef-f74f-4e2a-bb44-f143b1ff61d8/istio-proxy/0.log" Jun 11 12:48:00.490465 ip-10-0-141-209 kubenswrapper[2559]: I0611 12:48:00.490437 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-8tsts_d144c9f6-7121-4f68-9d45-0f31e1ab4a46/payload-pre-processing/0.log"