Jun 07 16:24:30.787531 ip-10-0-140-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 07 16:24:30.787548 ip-10-0-140-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 07 16:24:30.787558 ip-10-0-140-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 07 16:24:30.787928 ip-10-0-140-203 systemd[1]: Failed to start Kubernetes Kubelet. Jun 07 16:24:41.027731 ip-10-0-140-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 07 16:24:41.027749 ip-10-0-140-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4df7117c75f84e3485ec442be85d0265 -- Jun 07 16:27:20.894179 ip-10-0-140-203 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:27:21.281432 ip-10-0-140-203 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:21.281432 ip-10-0-140-203 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:27:21.281432 ip-10-0-140-203 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:21.282010 ip-10-0-140-203 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:27:21.282010 ip-10-0-140-203 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:21.284124 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.284047 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:27:21.290662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290641 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.290662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290660 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.290662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290664 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.290662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290667 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290671 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290674 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290677 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290680 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290683 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290685 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290688 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290690 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290693 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290695 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290698 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290700 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290703 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290706 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290708 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290711 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290713 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290715 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290718 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.290858 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290720 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290723 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290726 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290730 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290734 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290738 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290741 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290744 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290747 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290758 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290761 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290763 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290766 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290768 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290772 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290774 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290777 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290780 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290782 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.291342 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290785 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290787 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290790 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290792 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290795 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290798 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290813 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290816 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290819 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290822 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290824 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290827 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290829 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290832 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290834 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290837 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290839 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290842 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290844 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290847 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.291817 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290849 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290852 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290855 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290858 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290862 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290866 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290868 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290872 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290875 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290878 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290880 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290883 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290886 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290888 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290891 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290893 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290896 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290898 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290901 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.292298 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290904 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290906 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290909 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290911 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290915 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290918 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290921 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290924 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290926 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290929 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290931 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290934 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290937 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290940 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290942 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290945 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290947 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.290950 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291649 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291657 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.292749 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291661 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291664 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291667 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291669 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291672 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291675 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291677 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291680 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291683 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291686 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291688 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291691 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291694 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291696 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291699 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291702 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291706 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291708 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291711 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291713 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.293251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291729 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291733 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291737 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291740 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291743 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291746 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291749 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291752 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291755 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291757 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291760 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291762 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291765 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291769 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291771 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291774 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291776 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291779 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291782 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291784 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.293750 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291788 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291790 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291793 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291796 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291814 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291817 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291820 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291823 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291828 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291831 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291835 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291838 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291840 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291843 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291846 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291848 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291851 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291853 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291856 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291858 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.294251 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291861 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291863 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291866 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291868 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291871 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291874 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291877 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291879 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291881 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291884 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291886 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291889 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291891 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291895 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291899 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291902 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291904 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291907 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291911 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.294761 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291914 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291917 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291920 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291923 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291925 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291928 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291930 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291933 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291935 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291940 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291943 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291945 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291948 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291951 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291953 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291956 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291959 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.291962 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292345 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292350 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.295241 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292353 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292356 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292359 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292362 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292365 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292367 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292370 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292373 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292375 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292378 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292380 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292383 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292385 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292388 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292391 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292394 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292397 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292399 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292402 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292405 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.295726 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292407 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292410 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292413 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292415 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292418 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292421 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292423 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292425 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292428 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292431 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292433 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292436 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292438 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292441 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292443 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292446 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292448 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292451 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292453 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292456 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.296254 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292458 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292461 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292463 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292468 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292471 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292474 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292477 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292480 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292483 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292485 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292488 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292490 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292494 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292497 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292500 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292503 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292505 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292508 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292510 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.296731 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292513 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292515 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292519 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292523 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292526 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292528 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292531 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292533 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292535 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292538 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292542 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292545 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292547 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292550 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292552 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292554 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292557 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292559 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292563 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.297211 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292566 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292568 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292571 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292574 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292576 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292579 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292581 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292584 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292586 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292589 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292591 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292594 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292596 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292599 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292601 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292604 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292607 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292609 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.292612 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292685 2571 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:27:21.297704 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292700 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292709 2571 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292716 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292723 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292728 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292734 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292739 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292742 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292745 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292748 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292752 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292755 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292758 2571 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292762 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292765 2571 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292768 2571 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292771 2571 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292776 2571 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292779 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292782 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292785 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292788 2571 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292791 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:27:21.298199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292794 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292797 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292820 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292824 2571 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292827 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292830 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292833 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292835 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292840 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292843 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292845 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292848 2571 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292853 2571 flags.go:64] FLAG: --enable-server="true" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292856 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292860 2571 flags.go:64] FLAG: --event-burst="100" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292863 2571 flags.go:64] FLAG: --event-qps="50" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292866 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292869 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292871 2571 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292875 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292878 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292881 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292883 2571 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292886 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292889 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:27:21.298747 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292893 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292896 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292899 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292903 2571 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292906 2571 flags.go:64] FLAG: --feature-gates="" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292909 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292912 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292915 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292918 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292921 2571 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292924 2571 flags.go:64] FLAG: --help="false" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292926 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292929 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292932 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292936 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292939 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292942 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292945 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292948 2571 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292952 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292955 2571 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292958 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292961 2571 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292963 2571 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:27:21.299367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292966 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292969 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292972 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292975 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292977 2571 flags.go:64] FLAG: --lock-file="" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292980 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292983 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292986 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292991 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292994 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.292997 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293001 2571 flags.go:64] FLAG: --logging-format="text" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293004 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293007 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293009 2571 flags.go:64] FLAG: --manifest-url="" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293012 2571 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293016 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293019 2571 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293023 2571 flags.go:64] FLAG: --max-pods="110" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293026 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293029 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293031 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293034 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293037 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293039 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:27:21.299982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293042 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293049 2571 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293053 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293056 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293059 2571 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293062 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293067 2571 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293069 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293072 2571 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293075 2571 flags.go:64] FLAG: --port="10250" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293078 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293081 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba6bbb93395b3fa6" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293084 2571 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293086 2571 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293090 2571 flags.go:64] FLAG: --register-node="true" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293092 2571 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293096 2571 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293099 2571 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293102 2571 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293105 2571 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293109 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293112 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293115 2571 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293118 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293120 2571 flags.go:64] FLAG: --runonce="false" Jun 07 16:27:21.300600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293123 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293126 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293128 2571 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293131 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293134 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293136 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293139 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293142 2571 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293145 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293149 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293151 2571 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293154 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293157 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293159 2571 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293162 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293167 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293170 2571 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293172 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293176 2571 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293179 2571 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293182 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293184 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293187 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293190 2571 flags.go:64] FLAG: --v="2" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293194 2571 flags.go:64] FLAG: --version="false" Jun 07 16:27:21.301334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293198 2571 flags.go:64] FLAG: --vmodule="" Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293202 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293205 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293316 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293320 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293322 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293325 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293328 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293331 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293333 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293336 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293338 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293341 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293343 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293346 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293349 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293353 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293355 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293358 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293360 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.301966 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293363 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293365 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293368 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293371 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293373 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293375 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293378 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293380 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293383 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293385 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293388 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293390 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293393 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293398 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293400 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293403 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293405 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293408 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293410 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293413 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.302459 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293415 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293418 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293420 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293423 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293425 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293428 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293431 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293433 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293436 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293439 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293441 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293444 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293447 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293449 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293452 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293454 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293457 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293459 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293462 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293464 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.302975 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293467 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293469 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293472 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293474 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293476 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293480 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293483 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293486 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293488 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293490 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293493 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293495 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293499 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293503 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293506 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293509 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293512 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293515 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293518 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.303446 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293522 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293525 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293528 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293531 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293533 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293536 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293538 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293541 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293543 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293546 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293548 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293551 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293553 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293556 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293558 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293561 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293563 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293566 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293571 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293574 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.304014 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293577 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293580 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.293583 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.293588 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.300285 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.300299 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.300318 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.300323 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300377 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300381 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300384 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300387 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300390 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300393 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300396 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.304494 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300399 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300402 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300406 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300410 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300412 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300415 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300418 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300421 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300423 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300426 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300428 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300431 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300433 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300438 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300441 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300444 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300447 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300450 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300453 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300456 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.304898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300458 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300461 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300464 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300467 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300469 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300472 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300474 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300477 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300479 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300482 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300484 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300486 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300489 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300491 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300494 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300497 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300499 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300502 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300504 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300507 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.305385 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300509 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300512 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300514 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300517 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300519 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300522 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300524 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300527 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300529 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300532 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300535 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300538 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300541 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300544 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300547 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300549 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300552 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300555 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300557 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300560 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.305874 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300562 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300565 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300567 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300570 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300572 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300575 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300579 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300582 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300585 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300588 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300590 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300593 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300596 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300598 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300601 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300604 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300607 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300610 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300612 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.306353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300615 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300618 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300621 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300623 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300625 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300628 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300631 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300633 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300636 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300639 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300641 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300644 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300646 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.300651 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:21.306853 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300759 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300764 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300769 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300772 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300774 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300777 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300780 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300782 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300785 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300787 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300790 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300792 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300795 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300798 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300826 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300828 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300831 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300834 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300836 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:21.307192 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300839 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300841 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300844 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300846 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300848 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300851 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300853 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300856 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300859 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300862 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300865 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300867 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300870 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300872 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300874 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300877 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300880 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300882 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300884 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300887 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:21.307662 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300889 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300892 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300894 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300897 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300899 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300902 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300905 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300907 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300910 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300912 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300915 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300918 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300921 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300924 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300926 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300929 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300932 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300936 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300938 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:21.308156 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300941 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300944 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300947 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300950 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300952 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300955 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300958 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300961 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300964 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300966 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300968 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300971 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300973 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300976 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300978 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300981 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300983 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300986 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300988 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300991 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:21.308642 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300993 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300996 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.300998 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301001 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301003 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301006 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301008 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301010 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301013 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301015 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301017 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301020 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301022 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301025 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301028 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301030 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301033 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301035 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301038 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301040 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:21.309167 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:21.301043 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.301047 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.301175 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.304190 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.305554 2571 server.go:1019] "Starting client certificate rotation" Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.305654 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.305703 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:21.309919 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.308260 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:21.310310 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.310293 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:21.324772 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.324686 2571 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:27:21.327612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.327596 2571 log.go:25] "Validated CRI v1 image API" Jun 07 16:27:21.328341 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.328319 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:27:21.331572 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.331547 2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c42eb26f-50a7-4d09-aee7-cb053d47f8dd:/dev/nvme0n1p3 ec103565-2f14-4f88-87fc-282bf057274c:/dev/nvme0n1p4] Jun 07 16:27:21.331641 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.331572 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:27:21.336264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.336244 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:21.336701 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.336576 2571 manager.go:216] Machine: {Timestamp:2026-06-07 16:27:21.33518136 +0000 UTC m=+0.324072124 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099374 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e0968f1ef9afe34695167ba9f01ce SystemUUID:ec2e0968-f1ef-9afe-3469-5167ba9f01ce BootID:4df7117c-75f8-4e34-85ec-442be85d0265 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:31:a1:b3:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:31:a1:b3:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:df:9e:33:e9:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:27:21.336701 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.336695 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:27:21.336833 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.336792 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:27:21.339842 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.339812 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:27:21.339980 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.339846 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:27:21.340679 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.340670 2571 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:27:21.340708 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.340683 2571 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:27:21.340708 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.340690 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:21.341402 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.341391 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:21.342501 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.342491 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:27:21.346223 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346212 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:21.346328 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346318 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:27:21.346365 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346349 2571 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:27:21.346365 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346357 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:27:21.346417 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346373 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:27:21.346417 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346382 2571 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:27:21.346417 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346391 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:27:21.346961 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346946 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:21.347017 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.346969 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:21.349320 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.349305 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:27:21.357287 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.357257 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdbjp" Jun 07 16:27:21.357943 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.357925 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:27:21.358036 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.357956 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:27:21.358698 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358685 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358707 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358714 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358719 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358727 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358732 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358741 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358753 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358759 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358764 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358776 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:27:21.358788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358781 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:27:21.359134 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358828 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:27:21.359134 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.358834 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:27:21.359134 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.358971 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:27:21.359239 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.359221 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:27:21.362015 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362000 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:27:21.362140 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362128 2571 server.go:1268] "Started kubelet" Jun 07 16:27:21.362336 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362265 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:27:21.362476 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362464 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:27:21.362797 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362241 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:27:21.362975 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.362957 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdbjp" Jun 07 16:27:21.363107 ip-10-0-140-203 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:27:21.365000 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.364987 2571 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:27:21.365972 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.365951 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:27:21.370117 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.370090 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:27:21.372640 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.372620 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:27:21.372719 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.372623 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:21.372916 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.372887 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.373523 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373512 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:27:21.373633 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373514 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:27:21.373633 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373633 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:27:21.373793 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373655 2571 factory.go:55] Registering systemd factory Jun 07 16:27:21.373793 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373671 2571 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:27:21.373913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373817 2571 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:27:21.373913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.373827 2571 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:27:21.374466 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.370403 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-203.ec2.internal.18b6d9503fc50cd9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-203.ec2.internal,UID:ip-10-0-140-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-203.ec2.internal,},FirstTimestamp:2026-06-07 16:27:21.362099417 +0000 UTC m=+0.350990160,LastTimestamp:2026-06-07 16:27:21.362099417 +0000 UTC m=+0.350990160,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-203.ec2.internal,}" Jun 07 16:27:21.374651 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.374633 2571 factory.go:153] Registering CRI-O factory Jun 07 16:27:21.374651 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.374649 2571 factory.go:223] Registration of the crio container factory successfully Jun 07 16:27:21.374796 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.374688 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:27:21.374796 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.374709 2571 factory.go:103] Registering Raw factory Jun 07 16:27:21.374796 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.374719 2571 manager.go:1196] Started watching for new ooms in manager Jun 07 16:27:21.375176 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.375163 2571 manager.go:349] Starting recovery of all containers Jun 07 16:27:21.375514 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.375418 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:21.379760 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.379609 2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-203.ec2.internal\" not found" node="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.385483 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.385464 2571 manager.go:354] Recovery completed Jun 07 16:27:21.389906 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.389892 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.391895 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.391881 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.391948 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.391907 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.391948 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.391917 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.392366 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.392353 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:27:21.392429 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.392366 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:27:21.392429 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.392385 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:21.392429 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.392357 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.393073 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393058 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.393125 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393084 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.393125 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393093 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.393696 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393682 2571 policy_none.go:49] "None policy: Start" Jun 07 16:27:21.393745 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393702 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:27:21.393745 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.393716 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:27:21.394840 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.394828 2571 policy_none.go:47] "Start" Jun 07 16:27:21.438426 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438409 2571 manager.go:337] "Starting Device Plugin manager" Jun 07 16:27:21.438549 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.438451 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:27:21.438549 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438464 2571 server.go:87] "Starting device plugin registration server" Jun 07 16:27:21.438549 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438489 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:27:21.438742 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438693 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:27:21.438742 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438710 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:27:21.438917 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438897 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:27:21.438917 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438975 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:27:21.438917 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.438984 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:27:21.439417 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.439390 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:27:21.439469 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.439439 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.440356 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.440340 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:27:21.440410 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.440381 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:27:21.440410 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.440403 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:27:21.440496 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.440438 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 16:27:21.442944 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.442928 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:21.538864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.538791 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.539607 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.539591 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.539684 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.539621 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.539684 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.539634 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.539684 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.539661 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.540842 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.540825 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal"] Jun 07 16:27:21.540898 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.540881 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.542242 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.542228 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.542310 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.542253 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.542310 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.542262 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.543610 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.543598 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.543707 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.543691 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.543748 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.543722 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.544246 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544229 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.544321 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544229 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.544321 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544278 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.544321 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544289 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.544321 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544256 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.544438 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.544335 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.545436 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.545425 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.545476 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.545447 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:21.546083 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.546062 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:21.546140 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.546094 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:21.546140 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.546104 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:21.547308 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.547290 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.547409 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.547315 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-203.ec2.internal\": node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.559782 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.559766 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.570718 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.570694 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-203.ec2.internal\" not found" node="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.574505 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.574490 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-203.ec2.internal\" not found" node="ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.575548 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.575532 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1861c4be82b6aa960b9ea3296f37a0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-203.ec2.internal\" (UID: \"1a1861c4be82b6aa960b9ea3296f37a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.575619 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.575557 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.575619 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.575582 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.660814 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.660787 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.676267 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676246 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1861c4be82b6aa960b9ea3296f37a0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-203.ec2.internal\" (UID: \"1a1861c4be82b6aa960b9ea3296f37a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.676335 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.676373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676358 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.676373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a1861c4be82b6aa960b9ea3296f37a0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-203.ec2.internal\" (UID: \"1a1861c4be82b6aa960b9ea3296f37a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.676373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676320 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.676464 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.676414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2781a0c17c5d9baca6d3b1baecd329b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal\" (UID: \"2781a0c17c5d9baca6d3b1baecd329b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.761568 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.761544 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.862325 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.862270 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:21.875564 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.875548 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.879645 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:21.879631 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:21.963368 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:21.963341 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:22.063855 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.063841 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:22.164358 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.164307 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:22.264957 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.264940 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-203.ec2.internal\" not found" Jun 07 16:27:22.276897 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.276876 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:22.305020 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.305001 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:27:22.305531 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.305133 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:22.305531 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.305142 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:22.305531 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.305137 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:22.347335 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.347312 2571 apiserver.go:52] "Watching apiserver" Jun 07 16:27:22.349138 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.349115 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2781a0c17c5d9baca6d3b1baecd329b6.slice/crio-64e67c8016149bdae03952043d9dddafd3acc5366298abd59d2424936675c680 WatchSource:0}: Error finding container 64e67c8016149bdae03952043d9dddafd3acc5366298abd59d2424936675c680: Status 404 returned error can't find the container with id 64e67c8016149bdae03952043d9dddafd3acc5366298abd59d2424936675c680 Jun 07 16:27:22.349587 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.349565 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1861c4be82b6aa960b9ea3296f37a0.slice/crio-84b204d8fd6cf9d74abbe081815b66d8aaafcdc919fc829c54f3d1cea1e068a4 WatchSource:0}: Error finding container 84b204d8fd6cf9d74abbe081815b66d8aaafcdc919fc829c54f3d1cea1e068a4: Status 404 returned error can't find the container with id 84b204d8fd6cf9d74abbe081815b66d8aaafcdc919fc829c54f3d1cea1e068a4 Jun 07 16:27:22.353276 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.353258 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:27:22.365355 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.365329 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:27:22.366377 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.366357 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz","openshift-image-registry/node-ca-9p4v7","openshift-multus/multus-rbsqc","openshift-network-diagnostics/network-check-target-qx6fz","kube-system/global-pull-secret-syncer-cm5mb","kube-system/konnectivity-agent-kt4xf","openshift-cluster-node-tuning-operator/tuned-fz5wc","openshift-dns/node-resolver-jpc55","openshift-multus/multus-additional-cni-plugins-hstwv","openshift-multus/network-metrics-daemon-g7f8s","openshift-network-operator/iptables-alerter-x7tvs","openshift-ovn-kubernetes/ovnkube-node-9787q"] Jun 07 16:27:22.368314 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.368297 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.369452 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.369433 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.370372 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.370341 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 16:22:21 +0000 UTC" deadline="2027-12-03 16:25:36.663381317 +0000 UTC" Jun 07 16:27:22.370447 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.370372 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13055h58m14.293012674s" Jun 07 16:27:22.370579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.370564 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.371681 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.371667 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:22.371764 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.371728 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:22.372773 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.372759 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:22.372865 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.372835 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.372919 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.372885 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:22.373178 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.373160 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" Jun 07 16:27:22.373990 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.373967 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.374489 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.374270 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.374705 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.374686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.374779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.374735 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l687z\"" Jun 07 16:27:22.374779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.374750 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.374876 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.374750 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:27:22.375160 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375140 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.375281 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375265 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.375345 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375289 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.375436 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375421 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:27:22.375496 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375438 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:27:22.375496 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375445 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.375592 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375441 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-994m5\"" Jun 07 16:27:22.375592 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375437 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbmgx\"" Jun 07 16:27:22.375592 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.375531 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:27:22.376368 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.376351 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.377642 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.377622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.377915 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.377894 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:27:22.377994 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.377959 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:27:22.378876 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.378863 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.378927 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.378911 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:22.379688 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:22.379688 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379555 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-socket-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.379688 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379615 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-sys-fs\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.379688 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379654 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-system-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379691 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-k8s-cni-cncf-io\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-conf-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379750 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bpn\" (UniqueName: \"kubernetes.io/projected/f1f8e905-a383-4382-8eee-614e403aa014-kube-api-access-d6bpn\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379781 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-cnibin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379834 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-netns\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379909 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-bin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.379967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379937 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-hostroot\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.379966 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-multus-certs\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-etc-kubernetes\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380069 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-dbus\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380107 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsq2d\" (UniqueName: \"kubernetes.io/projected/943eb10a-03c7-4fc3-a29f-1771d65b346e-kube-api-access-gsq2d\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380131 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-kubelet\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380171 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-konnectivity-ca\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380210 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7l87\" (UniqueName: \"kubernetes.io/projected/d26a0cc6-ddf5-4d45-8145-b94262625936-kube-api-access-c7l87\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.380252 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/943eb10a-03c7-4fc3-a29f-1771d65b346e-host\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380288 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-os-release\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380316 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-multus-daemon-config\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380360 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-cni-binary-copy\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380402 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-agent-certs\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380501 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/943eb10a-03c7-4fc3-a29f-1771d65b346e-serviceca\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.380588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380559 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380952 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380600 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-socket-dir-parent\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380952 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380625 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-multus\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.380952 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380697 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-kubelet-config\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.380952 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380779 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtwzz\"" Jun 07 16:27:22.381235 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.380736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.381295 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.381252 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-registration-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.381295 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.381283 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-device-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.381449 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.381313 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.382760 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.382740 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383138 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383155 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2wcf\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383211 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383302 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383325 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383482 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383514 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9v698\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383530 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-626gd\"" Jun 07 16:27:22.383828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.383533 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.384325 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.384310 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.385192 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.385174 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.389280 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.389259 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.389368 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.389261 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84w2s\"" Jun 07 16:27:22.389368 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.389332 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:27:22.390322 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390294 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:27:22.390403 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390336 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fknfb\"" Jun 07 16:27:22.390403 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390298 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:27:22.390403 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390387 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:27:22.390528 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390407 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:27:22.390528 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390367 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:27:22.390759 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.390744 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:27:22.397468 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.397454 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:22.397542 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.397523 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" Jun 07 16:27:22.399560 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.399544 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal"] Jun 07 16:27:22.418195 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.418178 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:22.419168 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.419155 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal"] Jun 07 16:27:22.420335 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.420321 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:22.444019 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.443988 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" event={"ID":"1a1861c4be82b6aa960b9ea3296f37a0","Type":"ContainerStarted","Data":"84b204d8fd6cf9d74abbe081815b66d8aaafcdc919fc829c54f3d1cea1e068a4"} Jun 07 16:27:22.445016 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.444998 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" event={"ID":"2781a0c17c5d9baca6d3b1baecd329b6","Type":"ContainerStarted","Data":"64e67c8016149bdae03952043d9dddafd3acc5366298abd59d2424936675c680"} Jun 07 16:27:22.455692 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.455673 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq992" Jun 07 16:27:22.474562 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.474546 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:27:22.482280 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482258 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlv8z\" (UniqueName: \"kubernetes.io/projected/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-kube-api-access-tlv8z\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.482371 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482282 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3eaea69-693d-4cf8-bcac-7fa2a047b391-host-slash\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.482371 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482299 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-lib-modules\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482371 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482313 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.482371 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482353 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9p52\" (UniqueName: \"kubernetes.io/projected/a9ad68bc-9016-4ece-a165-e1788697d5ca-kube-api-access-n9p52\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482390 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482403 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-node-log\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-log-socket\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482468 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7l87\" (UniqueName: \"kubernetes.io/projected/d26a0cc6-ddf5-4d45-8145-b94262625936-kube-api-access-c7l87\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482484 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/943eb10a-03c7-4fc3-a29f-1771d65b346e-host\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.482536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482511 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-os-release\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/943eb10a-03c7-4fc3-a29f-1771d65b346e-host\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482574 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-os-release\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482634 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-host\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482656 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-tuned\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482673 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482689 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482703 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-env-overrides\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482716 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482730 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-run\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482750 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-sys\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482766 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-netns\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-agent-certs\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482798 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.482845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482836 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/943eb10a-03c7-4fc3-a29f-1771d65b346e-serviceca\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482926 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482961 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-etc-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482972 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.482989 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-device-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483018 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-tmp\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483029 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-device-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483037 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483041 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-var-lib-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483068 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483094 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-config\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483117 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspl5\" (UniqueName: \"kubernetes.io/projected/bc7a79d0-637d-483b-b32f-207f395e07c2-kube-api-access-fspl5\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483143 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-os-release\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483164 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/943eb10a-03c7-4fc3-a29f-1771d65b346e-serviceca\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483167 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t68v\" (UniqueName: \"kubernetes.io/projected/dd705cc3-6364-405b-9ab7-6e7b18b350f6-kube-api-access-7t68v\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483195 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shwx7\" (UniqueName: \"kubernetes.io/projected/a3eaea69-693d-4cf8-bcac-7fa2a047b391-kube-api-access-shwx7\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.483412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483257 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-script-lib\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-socket-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-sys-fs\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483328 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-system-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483349 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-k8s-cni-cncf-io\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483372 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-conf-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483374 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-sys-fs\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483388 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-socket-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bpn\" (UniqueName: \"kubernetes.io/projected/f1f8e905-a383-4382-8eee-614e403aa014-kube-api-access-d6bpn\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483417 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-system-cni-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483417 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-conf-dir\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483451 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-k8s-cni-cncf-io\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483536 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-kubernetes\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483574 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-netns\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483599 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-etc-kubernetes\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483623 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-cnibin\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.484244 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483624 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-netns\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483675 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-etc-kubernetes\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483676 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-slash\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483712 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-netd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483739 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovn-node-metrics-cert\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483762 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8b2\" (UniqueName: \"kubernetes.io/projected/00fe385a-2d6f-4b00-9983-5e910ff876ef-kube-api-access-ct8b2\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483788 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-dbus\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483839 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsq2d\" (UniqueName: \"kubernetes.io/projected/943eb10a-03c7-4fc3-a29f-1771d65b346e-kube-api-access-gsq2d\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-kubelet\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483887 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3eaea69-693d-4cf8-bcac-7fa2a047b391-iptables-alerter-script\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483914 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-konnectivity-ca\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483933 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-dbus\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.483935 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-kubelet\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484033 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-multus-daemon-config\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-cni-binary-copy\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484086 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-systemd\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.485021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484109 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484225 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484275 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-systemd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-bin\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484323 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-socket-dir-parent\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484349 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-multus\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysconfig\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484393 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-kubelet-config\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484416 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484440 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-registration-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484445 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-konnectivity-ca\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484465 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-systemd-units\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484482 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-multus\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484496 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484518 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-modprobe-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484542 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-var-lib-kubelet\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484541 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.485526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484555 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-multus-daemon-config\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1f8e905-a383-4382-8eee-614e403aa014-cni-binary-copy\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484572 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-hosts-file\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d26a0cc6-ddf5-4d45-8145-b94262625936-registration-dir\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-multus-socket-dir-parent\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484604 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a8596a-458b-4209-a487-f7c983032b79-kubelet-config\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484625 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-tmp-dir\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484657 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-kubelet\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.484674 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484679 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-ovn\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484704 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-cnibin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484728 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-bin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484749 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-hostroot\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484752 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq992" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484773 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-multus-certs\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484797 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-conf\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484824 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-var-lib-cni-bin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484865 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-hostroot\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486058 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.484872 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:22.984840079 +0000 UTC m=+1.973730825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:22.486596 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484914 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-cnibin\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486596 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.484949 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1f8e905-a383-4382-8eee-614e403aa014-host-run-multus-certs\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.486596 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.486572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27ff00bb-1b24-4b1a-af98-20b2ed8b4df3-agent-certs\") pod \"konnectivity-agent-kt4xf\" (UID: \"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3\") " pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.491587 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.491570 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:22.491587 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.491587 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:22.491674 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.491597 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:22.491674 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.491642 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:22.991630671 +0000 UTC m=+1.980521421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:22.492891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.492868 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bpn\" (UniqueName: \"kubernetes.io/projected/f1f8e905-a383-4382-8eee-614e403aa014-kube-api-access-d6bpn\") pod \"multus-rbsqc\" (UID: \"f1f8e905-a383-4382-8eee-614e403aa014\") " pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.493221 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.493203 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsq2d\" (UniqueName: \"kubernetes.io/projected/943eb10a-03c7-4fc3-a29f-1771d65b346e-kube-api-access-gsq2d\") pod \"node-ca-9p4v7\" (UID: \"943eb10a-03c7-4fc3-a29f-1771d65b346e\") " pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.493828 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.493786 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7l87\" (UniqueName: \"kubernetes.io/projected/d26a0cc6-ddf5-4d45-8145-b94262625936-kube-api-access-c7l87\") pod \"aws-ebs-csi-driver-node-9rrbz\" (UID: \"d26a0cc6-ddf5-4d45-8145-b94262625936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.585454 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585431 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-conf\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585462 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlv8z\" (UniqueName: \"kubernetes.io/projected/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-kube-api-access-tlv8z\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585477 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3eaea69-693d-4cf8-bcac-7fa2a047b391-host-slash\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585491 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-lib-modules\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585512 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585535 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585554 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3eaea69-693d-4cf8-bcac-7fa2a047b391-host-slash\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585560 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9p52\" (UniqueName: \"kubernetes.io/projected/a9ad68bc-9016-4ece-a165-e1788697d5ca-kube-api-access-n9p52\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.585579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585582 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585593 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585604 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-node-log\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585630 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-lib-modules\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585634 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-log-socket\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585646 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-node-log\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585665 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-log-socket\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585665 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585672 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-host\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585706 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-host\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-tuned\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-conf\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585749 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-env-overrides\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585829 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585848 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-run\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585847 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586014 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585872 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-sys\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585894 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-netns\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585909 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-run\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585923 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-etc-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585939 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysctl-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585948 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-tmp\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585963 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-sys\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585971 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-var-lib-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.585978 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-run-netns\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586004 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-etc-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586008 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586036 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-config\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586042 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-var-lib-openvswitch\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586060 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspl5\" (UniqueName: \"kubernetes.io/projected/bc7a79d0-637d-483b-b32f-207f395e07c2-kube-api-access-fspl5\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586078 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586131 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-os-release\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586081 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-os-release\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.586713 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586264 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586276 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-env-overrides\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t68v\" (UniqueName: \"kubernetes.io/projected/dd705cc3-6364-405b-9ab7-6e7b18b350f6-kube-api-access-7t68v\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586285 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586333 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shwx7\" (UniqueName: \"kubernetes.io/projected/a3eaea69-693d-4cf8-bcac-7fa2a047b391-kube-api-access-shwx7\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586422 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-script-lib\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586583 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-kubernetes\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586607 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-cnibin\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586632 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586657 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-slash\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586680 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-netd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovn-node-metrics-cert\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586732 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8b2\" (UniqueName: \"kubernetes.io/projected/00fe385a-2d6f-4b00-9983-5e910ff876ef-kube-api-access-ct8b2\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586751 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-config\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586760 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3eaea69-693d-4cf8-bcac-7fa2a047b391-iptables-alerter-script\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586792 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovnkube-script-lib\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586788 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-systemd\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.587327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586861 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586877 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-kubernetes\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586886 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586910 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-systemd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586920 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-cnibin\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586934 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-bin\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586958 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysconfig\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586982 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-systemd-units\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-modprobe-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587055 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-var-lib-kubelet\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587079 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-hosts-file\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-tmp-dir\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587123 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-kubelet\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9ad68bc-9016-4ece-a165-e1788697d5ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587146 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-ovn\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587195 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-ovn\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587259 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-systemd\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.587329 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:22.588107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587338 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9ad68bc-9016-4ece-a165-e1788697d5ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.587384 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:23.087367795 +0000 UTC m=+2.076258531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587399 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-netd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.586834 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-slash\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587510 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-modprobe-d\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587562 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-systemd-units\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587563 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-cni-bin\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587604 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-sysconfig\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587619 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-hosts-file\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587658 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-run-systemd\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc7a79d0-637d-483b-b32f-207f395e07c2-var-lib-kubelet\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587714 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00fe385a-2d6f-4b00-9983-5e910ff876ef-host-kubelet\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587762 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3eaea69-693d-4cf8-bcac-7fa2a047b391-iptables-alerter-script\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.587943 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-tmp-dir\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.588271 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-etc-tuned\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.588664 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.588319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7a79d0-637d-483b-b32f-207f395e07c2-tmp\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.589135 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.588744 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00fe385a-2d6f-4b00-9983-5e910ff876ef-ovn-node-metrics-cert\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.594733 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.594709 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlv8z\" (UniqueName: \"kubernetes.io/projected/f2945f93-8b68-4f02-ba8b-eb5c0a68e375-kube-api-access-tlv8z\") pod \"node-resolver-jpc55\" (UID: \"f2945f93-8b68-4f02-ba8b-eb5c0a68e375\") " pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.595696 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.595670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shwx7\" (UniqueName: \"kubernetes.io/projected/a3eaea69-693d-4cf8-bcac-7fa2a047b391-kube-api-access-shwx7\") pod \"iptables-alerter-x7tvs\" (UID: \"a3eaea69-693d-4cf8-bcac-7fa2a047b391\") " pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.595765 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.595746 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspl5\" (UniqueName: \"kubernetes.io/projected/bc7a79d0-637d-483b-b32f-207f395e07c2-kube-api-access-fspl5\") pod \"tuned-fz5wc\" (UID: \"bc7a79d0-637d-483b-b32f-207f395e07c2\") " pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.595930 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.595916 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9p52\" (UniqueName: \"kubernetes.io/projected/a9ad68bc-9016-4ece-a165-e1788697d5ca-kube-api-access-n9p52\") pod \"multus-additional-cni-plugins-hstwv\" (UID: \"a9ad68bc-9016-4ece-a165-e1788697d5ca\") " pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.596465 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.596447 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t68v\" (UniqueName: \"kubernetes.io/projected/dd705cc3-6364-405b-9ab7-6e7b18b350f6-kube-api-access-7t68v\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:22.596659 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.596644 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8b2\" (UniqueName: \"kubernetes.io/projected/00fe385a-2d6f-4b00-9983-5e910ff876ef-kube-api-access-ct8b2\") pod \"ovnkube-node-9787q\" (UID: \"00fe385a-2d6f-4b00-9983-5e910ff876ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.632289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.632262 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:22.677286 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.677238 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" Jun 07 16:27:22.684653 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.684635 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26a0cc6_ddf5_4d45_8145_b94262625936.slice/crio-1752f2d738c0cb6501bb154ced166ea37d3a6cf3ba0433bd22e3c6907b246d27 WatchSource:0}: Error finding container 1752f2d738c0cb6501bb154ced166ea37d3a6cf3ba0433bd22e3c6907b246d27: Status 404 returned error can't find the container with id 1752f2d738c0cb6501bb154ced166ea37d3a6cf3ba0433bd22e3c6907b246d27 Jun 07 16:27:22.685516 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.685504 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9p4v7" Jun 07 16:27:22.692115 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.692098 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rbsqc" Jun 07 16:27:22.693574 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.693549 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943eb10a_03c7_4fc3_a29f_1771d65b346e.slice/crio-5ff2966322dbe8f78dd8e9bdb8fc7414cb506087485049db780f5964de0492de WatchSource:0}: Error finding container 5ff2966322dbe8f78dd8e9bdb8fc7414cb506087485049db780f5964de0492de: Status 404 returned error can't find the container with id 5ff2966322dbe8f78dd8e9bdb8fc7414cb506087485049db780f5964de0492de Jun 07 16:27:22.695847 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.695830 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:22.698934 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.698913 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f8e905_a383_4382_8eee_614e403aa014.slice/crio-67440dacd19616dc16d3e7a1b4115b7029007c3e62ccdcb062bb8595a305ecd5 WatchSource:0}: Error finding container 67440dacd19616dc16d3e7a1b4115b7029007c3e62ccdcb062bb8595a305ecd5: Status 404 returned error can't find the container with id 67440dacd19616dc16d3e7a1b4115b7029007c3e62ccdcb062bb8595a305ecd5 Jun 07 16:27:22.701901 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.701885 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" Jun 07 16:27:22.703531 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.703514 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ff00bb_1b24_4b1a_af98_20b2ed8b4df3.slice/crio-89239ce799340441e889f34692c9c1c27bf25e5dc5ad498165f9b45b91742647 WatchSource:0}: Error finding container 89239ce799340441e889f34692c9c1c27bf25e5dc5ad498165f9b45b91742647: Status 404 returned error can't find the container with id 89239ce799340441e889f34692c9c1c27bf25e5dc5ad498165f9b45b91742647 Jun 07 16:27:22.707151 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.707134 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpc55" Jun 07 16:27:22.708936 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.708920 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7a79d0_637d_483b_b32f_207f395e07c2.slice/crio-00c9c3d5febf3c484e7c652706128b0b758af7668daf297811e01f55ee09749a WatchSource:0}: Error finding container 00c9c3d5febf3c484e7c652706128b0b758af7668daf297811e01f55ee09749a: Status 404 returned error can't find the container with id 00c9c3d5febf3c484e7c652706128b0b758af7668daf297811e01f55ee09749a Jun 07 16:27:22.712658 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.712638 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hstwv" Jun 07 16:27:22.714089 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.714071 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2945f93_8b68_4f02_ba8b_eb5c0a68e375.slice/crio-9eec755d463c1ca0f38d58c0819afe7954f35c86e99c8e8bf13fb9b4967ac056 WatchSource:0}: Error finding container 9eec755d463c1ca0f38d58c0819afe7954f35c86e99c8e8bf13fb9b4967ac056: Status 404 returned error can't find the container with id 9eec755d463c1ca0f38d58c0819afe7954f35c86e99c8e8bf13fb9b4967ac056 Jun 07 16:27:22.718208 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.718193 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7tvs" Jun 07 16:27:22.720653 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.720638 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ad68bc_9016_4ece_a165_e1788697d5ca.slice/crio-b81708d9533dded2a87826be75fed0785a98ca30ff4f9141b1543d45e5df86dc WatchSource:0}: Error finding container b81708d9533dded2a87826be75fed0785a98ca30ff4f9141b1543d45e5df86dc: Status 404 returned error can't find the container with id b81708d9533dded2a87826be75fed0785a98ca30ff4f9141b1543d45e5df86dc Jun 07 16:27:22.722025 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.722011 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:22.726108 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.726087 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3eaea69_693d_4cf8_bcac_7fa2a047b391.slice/crio-85938888b4d4ca2105d5cf2a111f064a449cfb05ee7da743ff79c1158e4eff09 WatchSource:0}: Error finding container 85938888b4d4ca2105d5cf2a111f064a449cfb05ee7da743ff79c1158e4eff09: Status 404 returned error can't find the container with id 85938888b4d4ca2105d5cf2a111f064a449cfb05ee7da743ff79c1158e4eff09 Jun 07 16:27:22.731438 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:22.731419 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00fe385a_2d6f_4b00_9983_5e910ff876ef.slice/crio-91f8c59d8639037839a38afff0e91a227f0b4ec52028fc05569caafebb890b75 WatchSource:0}: Error finding container 91f8c59d8639037839a38afff0e91a227f0b4ec52028fc05569caafebb890b75: Status 404 returned error can't find the container with id 91f8c59d8639037839a38afff0e91a227f0b4ec52028fc05569caafebb890b75 Jun 07 16:27:22.989367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:22.989283 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:22.989527 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.989430 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:22.989527 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:22.989492 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:23.989473219 +0000 UTC m=+2.978363949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.089626 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.089709 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.089863 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.089884 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.089897 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.089950 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:24.089932895 +0000 UTC m=+3.078823646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.090299 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:23.090369 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.090333 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:24.090322856 +0000 UTC m=+3.079213586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:23.414905 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.414833 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:23.440970 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.440943 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:23.441122 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.441067 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:23.487239 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.487181 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:22 +0000 UTC" deadline="2027-11-22 19:58:36.520075766 +0000 UTC" Jun 07 16:27:23.487239 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.487238 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12795h31m13.032841976s" Jun 07 16:27:23.492351 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.492318 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kt4xf" event={"ID":"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3","Type":"ContainerStarted","Data":"89239ce799340441e889f34692c9c1c27bf25e5dc5ad498165f9b45b91742647"} Jun 07 16:27:23.509482 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.509398 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9p4v7" event={"ID":"943eb10a-03c7-4fc3-a29f-1771d65b346e","Type":"ContainerStarted","Data":"5ff2966322dbe8f78dd8e9bdb8fc7414cb506087485049db780f5964de0492de"} Jun 07 16:27:23.526860 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.526742 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"91f8c59d8639037839a38afff0e91a227f0b4ec52028fc05569caafebb890b75"} Jun 07 16:27:23.544523 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.544494 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7tvs" event={"ID":"a3eaea69-693d-4cf8-bcac-7fa2a047b391","Type":"ContainerStarted","Data":"85938888b4d4ca2105d5cf2a111f064a449cfb05ee7da743ff79c1158e4eff09"} Jun 07 16:27:23.552005 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.551975 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" event={"ID":"bc7a79d0-637d-483b-b32f-207f395e07c2","Type":"ContainerStarted","Data":"00c9c3d5febf3c484e7c652706128b0b758af7668daf297811e01f55ee09749a"} Jun 07 16:27:23.563499 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.563447 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rbsqc" event={"ID":"f1f8e905-a383-4382-8eee-614e403aa014","Type":"ContainerStarted","Data":"67440dacd19616dc16d3e7a1b4115b7029007c3e62ccdcb062bb8595a305ecd5"} Jun 07 16:27:23.574289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.574255 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" event={"ID":"d26a0cc6-ddf5-4d45-8145-b94262625936","Type":"ContainerStarted","Data":"1752f2d738c0cb6501bb154ced166ea37d3a6cf3ba0433bd22e3c6907b246d27"} Jun 07 16:27:23.590601 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.588268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerStarted","Data":"b81708d9533dded2a87826be75fed0785a98ca30ff4f9141b1543d45e5df86dc"} Jun 07 16:27:23.601175 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.601150 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpc55" event={"ID":"f2945f93-8b68-4f02-ba8b-eb5c0a68e375","Type":"ContainerStarted","Data":"9eec755d463c1ca0f38d58c0819afe7954f35c86e99c8e8bf13fb9b4967ac056"} Jun 07 16:27:23.719296 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.719222 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:23.997551 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:23.997427 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:23.997770 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.997572 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:23.997770 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:23.997635 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:25.997617127 +0000 UTC m=+4.986507872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:24.098351 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.098314 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:24.098522 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.098408 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:24.098625 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098578 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:24.098625 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098603 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:24.098625 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098618 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:24.098765 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098677 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:26.098658472 +0000 UTC m=+5.087549205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:24.098765 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098747 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:24.098900 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.098781 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:26.09876875 +0000 UTC m=+5.087659485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:24.255710 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.255623 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:24.440705 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.440675 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:24.441210 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.440846 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:24.441277 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.441253 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:24.441361 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:24.441339 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:24.487754 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.487708 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:22 +0000 UTC" deadline="2027-12-02 03:09:34.939316488 +0000 UTC" Jun 07 16:27:24.487754 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:24.487753 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13018h42m10.451568101s" Jun 07 16:27:25.440855 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:25.440829 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:25.441275 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:25.440969 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:26.017255 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:26.017219 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:26.017438 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.017353 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:26.017438 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.017435 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:30.017414518 +0000 UTC m=+9.006305296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:26.118019 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:26.117984 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:26.118040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118146 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118165 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118193 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118203 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:30.118186174 +0000 UTC m=+9.107076908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:26.118209 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118207 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:26.118513 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.118260 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:30.118241904 +0000 UTC m=+9.107132649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:26.440630 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:26.440550 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:26.440791 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.440701 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:26.441102 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:26.441083 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:26.441466 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:26.441195 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:27.445663 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:27.445224 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:27.445663 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:27.445346 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:28.441082 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:28.441041 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:28.441272 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:28.441192 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:28.441583 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:28.441559 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:28.441720 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:28.441645 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:29.441868 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:29.441345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:29.441868 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:29.441477 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:30.056266 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:30.056220 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:30.056454 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.056403 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:30.056521 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.056463 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:38.056445337 +0000 UTC m=+17.045336074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:30.157329 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:30.157391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157521 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157606 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:38.157586644 +0000 UTC m=+17.146477377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157883 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157903 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157917 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:30.157988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.157962 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:38.157946688 +0000 UTC m=+17.146837425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:30.440835 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:30.440740 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:30.440954 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.440870 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:30.441307 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:30.441286 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:30.441396 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:30.441382 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:31.449881 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:31.449475 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:31.449881 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:31.449570 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:32.440602 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:32.440570 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:32.440777 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:32.440574 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:32.440777 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:32.440706 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:32.440777 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:32.440760 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:33.443601 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:33.443570 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:33.444054 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:33.443715 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:34.441161 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:34.441129 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:34.441161 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:34.441158 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:34.441428 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:34.441245 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:34.441428 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:34.441363 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:35.444395 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:35.444372 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:35.444830 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:35.444467 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:36.441208 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:36.441175 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:36.441375 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:36.441181 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:36.441375 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:36.441310 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:36.441466 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:36.441404 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:37.441191 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:37.441156 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:37.441595 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:37.441280 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:38.122782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:38.122748 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:38.122988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.122887 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:38.122988 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.122941 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:54.122928253 +0000 UTC m=+33.111818987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:38.223862 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:38.223821 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:38.224024 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:38.223916 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:38.224024 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.223987 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:38.224024 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.224023 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:38.224151 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.224037 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:38.224151 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.224046 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:38.224151 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.224060 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:54.224040081 +0000 UTC m=+33.212930826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:38.224151 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.224088 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:27:54.224072513 +0000 UTC m=+33.212963263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:38.440831 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:38.440731 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:38.440831 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:38.440738 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:38.441026 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.440879 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:38.441026 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:38.440941 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:39.441195 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:39.441159 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:39.441653 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:39.441293 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:40.441189 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:40.440968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:40.441355 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:40.440976 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:40.441355 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:40.441273 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:40.441727 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:40.441364 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:41.441311 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:41.441275 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:41.441478 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:41.441379 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:42.440764 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:42.440722 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:42.440957 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:42.440852 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:42.440957 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:42.440915 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:42.441077 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:42.441044 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:43.440891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.440870 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:43.441157 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:43.440964 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:43.655869 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.655771 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" event={"ID":"bc7a79d0-637d-483b-b32f-207f395e07c2","Type":"ContainerStarted","Data":"daf45d1d4ea0cb07c6b430e3e6ec7b6d9b116c50bdb18e784ce5ea7b0bf643ff"} Jun 07 16:27:43.658766 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.658739 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rbsqc" event={"ID":"f1f8e905-a383-4382-8eee-614e403aa014","Type":"ContainerStarted","Data":"5cb8ea4fe29cf4a08e0a18c8cdc25acb1c7e285d17670156cc68d042277f1217"} Jun 07 16:27:43.660185 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.660163 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" event={"ID":"1a1861c4be82b6aa960b9ea3296f37a0","Type":"ContainerStarted","Data":"900f8c9bda0345a816b6ec0fe949b8ff7f33f1c0a1c346b873161f0c93069d2b"} Jun 07 16:27:43.671104 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.671065 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fz5wc" podStartSLOduration=2.18067804 podStartE2EDuration="22.671053736s" totalImagesPullingTime="20.490375696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:43.670699932 +0000 UTC m=+22.659590684" watchObservedRunningTime="2026-06-07 16:27:43.671053736 +0000 UTC m=+22.659944505" Jun 07 16:27:43.681983 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.681950 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-203.ec2.internal" podStartSLOduration=21.681938575 podStartE2EDuration="21.681938575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:43.681903307 +0000 UTC m=+22.670794059" watchObservedRunningTime="2026-06-07 16:27:43.681938575 +0000 UTC m=+22.670829328" Jun 07 16:27:43.696413 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:43.696380 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rbsqc" podStartSLOduration=2.166489991 podStartE2EDuration="22.696368707s" totalImagesPullingTime="20.529878716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:43.696027706 +0000 UTC m=+22.684918457" watchObservedRunningTime="2026-06-07 16:27:43.696368707 +0000 UTC m=+22.685259459" Jun 07 16:27:44.441623 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.441560 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:44.442224 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:44.441687 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:44.442224 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.441746 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:44.442224 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:44.441885 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:44.663732 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.663555 2571 generic.go:356] "Generic (PLEG): container finished" podID="2781a0c17c5d9baca6d3b1baecd329b6" containerID="30bc8eeb604854bc9103a96bb3b268412da414e60c26d4949fedddc8ea43ebd9" exitCode=0 Jun 07 16:27:44.663884 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.663668 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" event={"ID":"2781a0c17c5d9baca6d3b1baecd329b6","Type":"ContainerDied","Data":"30bc8eeb604854bc9103a96bb3b268412da414e60c26d4949fedddc8ea43ebd9"} Jun 07 16:27:44.666586 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.666571 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:27:44.666994 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.666975 2571 generic.go:356] "Generic (PLEG): container finished" podID="00fe385a-2d6f-4b00-9983-5e910ff876ef" containerID="88eedb7c51d78d0eac00e8c7da22f00a921f7e6f9e0d3dc6bc443b423aa9563c" exitCode=1 Jun 07 16:27:44.667065 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667040 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"e2b53a7f29d8784f6029c19700782d6d06732f0cc016dc8d7c1ded178fccae27"} Jun 07 16:27:44.667132 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667116 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"620bad3dcc572f6cfb8d9e525d06539ffaee6f5f8cc088da58739296e316c0b4"} Jun 07 16:27:44.667185 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667172 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"e220a161a7246c171d9e21a5beaa118df34a79125f6d3ef5f2fa424971c1ac61"} Jun 07 16:27:44.667236 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667224 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"8dc2c8bef64da33eba2aaa6bbd76d238ec2fcf878fa40d5449c0c401b56c5b40"} Jun 07 16:27:44.667277 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667258 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerDied","Data":"88eedb7c51d78d0eac00e8c7da22f00a921f7e6f9e0d3dc6bc443b423aa9563c"} Jun 07 16:27:44.667317 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.667294 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"cd920941c8309b3e7d13e439ae20ab7718b4574f09cbccef6eff1f6b1577f008"} Jun 07 16:27:44.668424 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.668403 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" event={"ID":"d26a0cc6-ddf5-4d45-8145-b94262625936","Type":"ContainerStarted","Data":"ace4810daa602ddd8ae2085fac3291799b855200174aab8ef13932243a447693"} Jun 07 16:27:44.669703 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.669686 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerStarted","Data":"f3205862ec3b780f4dae017d3ff5e5d250b99fe2756c9074dff6548ce82df5f0"} Jun 07 16:27:44.673682 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.673660 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpc55" event={"ID":"f2945f93-8b68-4f02-ba8b-eb5c0a68e375","Type":"ContainerStarted","Data":"636d3fd3fafddb7fa02716b79e75585f8ebacbb1dc82d87ddc4522a6475bf403"} Jun 07 16:27:44.675039 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.675018 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kt4xf" event={"ID":"27ff00bb-1b24-4b1a-af98-20b2ed8b4df3","Type":"ContainerStarted","Data":"c2b65ee3c0747f232ad6d58c85e989bcab5739ba72d37b58a5fd086215837f28"} Jun 07 16:27:44.676456 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.676431 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9p4v7" event={"ID":"943eb10a-03c7-4fc3-a29f-1771d65b346e","Type":"ContainerStarted","Data":"440f5fb1261ab87dc947473d2e13798914fe4ee022959adcd9b8f657136655f9"} Jun 07 16:27:44.703580 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.703542 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9p4v7" podStartSLOduration=3.1974665939999998 podStartE2EDuration="23.703526308s" totalImagesPullingTime="20.506059714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:44.703132041 +0000 UTC m=+23.692022790" watchObservedRunningTime="2026-06-07 16:27:44.703526308 +0000 UTC m=+23.692417062" Jun 07 16:27:44.718008 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:44.717950 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kt4xf" podStartSLOduration=3.256680881 podStartE2EDuration="23.717934995s" totalImagesPullingTime="20.461254114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:44.717889331 +0000 UTC m=+23.706780082" watchObservedRunningTime="2026-06-07 16:27:44.717934995 +0000 UTC m=+23.706825747" Jun 07 16:27:45.440999 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.440971 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:45.441146 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:45.441076 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:45.634995 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.634973 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:27:45.679114 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.679090 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7tvs" event={"ID":"a3eaea69-693d-4cf8-bcac-7fa2a047b391","Type":"ContainerStarted","Data":"6e68b88041b479dcb3cd0401bb387d187b99a8b3f34de6f4506f7941640de6f8"} Jun 07 16:27:45.680679 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.680658 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" event={"ID":"d26a0cc6-ddf5-4d45-8145-b94262625936","Type":"ContainerStarted","Data":"3387b0adbef052fa6661b1d1896e5f6ca7d65d71d0304939803c4abfff831e2f"} Jun 07 16:27:45.681926 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.681906 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="f3205862ec3b780f4dae017d3ff5e5d250b99fe2756c9074dff6548ce82df5f0" exitCode=0 Jun 07 16:27:45.682036 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.682003 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"f3205862ec3b780f4dae017d3ff5e5d250b99fe2756c9074dff6548ce82df5f0"} Jun 07 16:27:45.692791 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.692730 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpc55" podStartSLOduration=4.208811514 podStartE2EDuration="24.692704574s" totalImagesPullingTime="20.48389306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:44.734606555 +0000 UTC m=+23.723497317" watchObservedRunningTime="2026-06-07 16:27:45.692704574 +0000 UTC m=+24.681595391" Jun 07 16:27:45.692923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.692904 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7tvs" podStartSLOduration=4.25695748 podStartE2EDuration="24.692899921s" totalImagesPullingTime="20.435942441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:45.692532566 +0000 UTC m=+24.681423300" watchObservedRunningTime="2026-06-07 16:27:45.692899921 +0000 UTC m=+24.681790673" Jun 07 16:27:45.896291 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.896262 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:45.896694 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:45.896676 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:46.441309 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.441276 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:46.441594 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:46.441398 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:46.441782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.441758 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:46.441932 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:46.441868 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:46.452812 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.452704 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:27:45.634992518Z","UUID":"509c1ce2-475b-4c62-898b-7dc8bf8b22a3","Handler":null,"Name":"","Endpoint":""} Jun 07 16:27:46.454419 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.454401 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:27:46.454560 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.454443 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:27:46.686901 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.686871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" event={"ID":"2781a0c17c5d9baca6d3b1baecd329b6","Type":"ContainerStarted","Data":"2d53bfcb3b70e0135c11d187ca331424a63e0b89268a16580ce69e45cea75a98"} Jun 07 16:27:46.693183 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.693120 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:27:46.694190 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.693847 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"3253e4bbfa0f58ce023e3a70a30ce528d757a53d4b0b9f41c2f9d3d2c89ad661"} Jun 07 16:27:46.694190 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.694131 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:46.694676 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.694656 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kt4xf" Jun 07 16:27:46.699868 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:46.699813 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-203.ec2.internal" podStartSLOduration=24.6997849 podStartE2EDuration="24.6997849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:46.699678371 +0000 UTC m=+25.688569123" watchObservedRunningTime="2026-06-07 16:27:46.6997849 +0000 UTC m=+25.688675642" Jun 07 16:27:47.441540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:47.441507 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:47.441690 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:47.441649 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:47.698264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:47.698180 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" event={"ID":"d26a0cc6-ddf5-4d45-8145-b94262625936","Type":"ContainerStarted","Data":"349b65ba9a7cced834ee3b6523d27631c11b43462444367e65dbf413d56a8f71"} Jun 07 16:27:47.715162 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:47.715115 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rrbz" podStartSLOduration=4.188072652 podStartE2EDuration="26.71510154s" totalImagesPullingTime="22.527028888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:47.714454256 +0000 UTC m=+26.703345010" watchObservedRunningTime="2026-06-07 16:27:47.71510154 +0000 UTC m=+26.703992291" Jun 07 16:27:48.440913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:48.440881 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:48.441074 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:48.440879 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:48.441074 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:48.441001 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:48.441592 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:48.441140 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:49.444329 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:49.444298 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:49.444717 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:49.444406 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:50.440787 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.440582 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:50.440925 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.440659 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:50.440925 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:50.440848 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:50.440925 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:50.440895 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:50.707621 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.707592 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:27:50.708235 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.707987 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"1ffa6c6fa8f15161e51d60b0dff4a43579f002cae8fa1b9d7e06d6de0331c014"} Jun 07 16:27:50.708297 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.708245 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:50.708497 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.708474 2571 scope.go:117] "RemoveContainer" containerID="88eedb7c51d78d0eac00e8c7da22f00a921f7e6f9e0d3dc6bc443b423aa9563c" Jun 07 16:27:50.709868 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.709844 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="c9fe0f88fc8935be7c97e4335aca76a1c024f1a07cf71e10c9de2cae126392e1" exitCode=0 Jun 07 16:27:50.709955 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.709879 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"c9fe0f88fc8935be7c97e4335aca76a1c024f1a07cf71e10c9de2cae126392e1"} Jun 07 16:27:50.724911 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:50.724894 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:51.441751 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.441549 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:51.442153 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:51.441858 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:51.716536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.716469 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:27:51.717037 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.716968 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" event={"ID":"00fe385a-2d6f-4b00-9983-5e910ff876ef","Type":"ContainerStarted","Data":"f8a593afd9ae3e6ab4dc2a47a49254d2f730c7fe63598c42cc3b74909576fa7e"} Jun 07 16:27:51.717463 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.717441 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:51.717551 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.717538 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:51.734926 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.734903 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:27:51.744698 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.744657 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" podStartSLOduration=9.646858833 podStartE2EDuration="30.744641298s" totalImagesPullingTime="21.097782465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:51.743145824 +0000 UTC m=+30.732036577" watchObservedRunningTime="2026-06-07 16:27:51.744641298 +0000 UTC m=+30.733532049" Jun 07 16:27:51.908392 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.908360 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cm5mb"] Jun 07 16:27:51.908578 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.908459 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:51.908578 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:51.908542 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:51.911492 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.911464 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qx6fz"] Jun 07 16:27:51.911622 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.911590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:51.911730 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:51.911709 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:51.912225 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.912201 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7f8s"] Jun 07 16:27:51.912326 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:51.912306 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:51.912429 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:51.912410 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:52.721103 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:52.721066 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="bd03b9e0d4a7501dfb03b8ed76619f36a75fcfb12d753fec0bf7c63a84eb4709" exitCode=0 Jun 07 16:27:52.721541 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:52.721157 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"bd03b9e0d4a7501dfb03b8ed76619f36a75fcfb12d753fec0bf7c63a84eb4709"} Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:53.441598 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:53.441713 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:53.441724 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:53.441856 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:53.441919 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:53.442085 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:53.441995 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:53.725226 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:53.725197 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="f9cc79c564a7478463976e7ae7b9eafc8bc67ad14aa472fbbc863a5e0e42b6a0" exitCode=0 Jun 07 16:27:53.725577 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:53.725292 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"f9cc79c564a7478463976e7ae7b9eafc8bc67ad14aa472fbbc863a5e0e42b6a0"} Jun 07 16:27:54.136184 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:54.136147 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:54.136368 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.136269 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:54.136368 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.136340 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret podName:d5a8596a-458b-4209-a487-f7c983032b79 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:26.136321547 +0000 UTC m=+65.125212280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret") pod "global-pull-secret-syncer-cm5mb" (UID: "d5a8596a-458b-4209-a487-f7c983032b79") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:54.237013 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:54.236942 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:54.237013 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:54.236988 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:54.237242 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237207 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:54.237242 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237238 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:54.237485 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237252 2571 projected.go:196] Error preparing data for projected volume kube-api-access-l7bq2 for pod openshift-network-diagnostics/network-check-target-qx6fz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:54.237485 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237314 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2 podName:80f7442e-0f85-4627-ac43-d5aff3e2effe nodeName:}" failed. No retries permitted until 2026-06-07 16:28:26.237293433 +0000 UTC m=+65.226184163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7bq2" (UniqueName: "kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2") pod "network-check-target-qx6fz" (UID: "80f7442e-0f85-4627-ac43-d5aff3e2effe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:54.237757 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237740 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:54.237834 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:54.237797 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:26.237779772 +0000 UTC m=+65.226670550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:55.441165 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:55.440970 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:55.441511 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:55.440976 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:55.441511 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:55.441244 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm5mb" podUID="d5a8596a-458b-4209-a487-f7c983032b79" Jun 07 16:27:55.441511 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:55.440976 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:55.441511 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:55.441309 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qx6fz" podUID="80f7442e-0f85-4627-ac43-d5aff3e2effe" Jun 07 16:27:55.441511 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:55.441379 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:27:56.334540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.334518 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-203.ec2.internal" event="NodeReady" Jun 07 16:27:56.334705 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.334644 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:27:56.371553 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.371484 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b5hhm"] Jun 07 16:27:56.376165 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.376145 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ztb8b"] Jun 07 16:27:56.376292 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.376255 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.378488 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.378464 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:27:56.378667 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.378635 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:27:56.378758 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.378694 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:27:56.380068 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.380046 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.382179 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.382160 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:27:56.382281 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.382252 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:27:56.382546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.382349 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8l4v2\"" Jun 07 16:27:56.382546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.382403 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:27:56.383688 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.383666 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5hhm"] Jun 07 16:27:56.386256 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.386238 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztb8b"] Jun 07 16:27:56.455789 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.455759 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr7gc\" (UniqueName: \"kubernetes.io/projected/1d9f052d-7795-4e0a-8612-3dc9c772605a-kube-api-access-zr7gc\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.456182 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.455820 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9f052d-7795-4e0a-8612-3dc9c772605a-config-volume\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.456182 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.455857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9f052d-7795-4e0a-8612-3dc9c772605a-tmp-dir\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.456182 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.455899 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556240 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556208 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr7gc\" (UniqueName: \"kubernetes.io/projected/1d9f052d-7795-4e0a-8612-3dc9c772605a-kube-api-access-zr7gc\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556240 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556243 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9f052d-7795-4e0a-8612-3dc9c772605a-config-volume\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556484 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9f052d-7795-4e0a-8612-3dc9c772605a-tmp-dir\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556484 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556463 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a251d10-e94f-4056-88a1-cc0c794b0278-cert\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.556571 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556571 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556549 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tkg7\" (UniqueName: \"kubernetes.io/projected/8a251d10-e94f-4056-88a1-cc0c794b0278-kube-api-access-7tkg7\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.556715 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556590 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9f052d-7795-4e0a-8612-3dc9c772605a-tmp-dir\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.556715 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:56.556688 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:56.556775 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:56.556756 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:27:57.056736071 +0000 UTC m=+36.045626806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:27:56.556864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.556849 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9f052d-7795-4e0a-8612-3dc9c772605a-config-volume\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.567199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.567173 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr7gc\" (UniqueName: \"kubernetes.io/projected/1d9f052d-7795-4e0a-8612-3dc9c772605a-kube-api-access-zr7gc\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:56.657755 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.657672 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a251d10-e94f-4056-88a1-cc0c794b0278-cert\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.657924 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.657754 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tkg7\" (UniqueName: \"kubernetes.io/projected/8a251d10-e94f-4056-88a1-cc0c794b0278-kube-api-access-7tkg7\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.660550 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.660530 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a251d10-e94f-4056-88a1-cc0c794b0278-cert\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.670141 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.670116 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tkg7\" (UniqueName: \"kubernetes.io/projected/8a251d10-e94f-4056-88a1-cc0c794b0278-kube-api-access-7tkg7\") pod \"ingress-canary-ztb8b\" (UID: \"8a251d10-e94f-4056-88a1-cc0c794b0278\") " pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:56.697030 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:56.697002 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ztb8b" Jun 07 16:27:57.060859 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.060827 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:57.061029 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:57.060937 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:57.061029 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:57.060988 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:27:58.060973374 +0000 UTC m=+37.049864104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:27:57.441606 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.441525 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:27:57.441606 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.441578 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:27:57.441785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.441641 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:27:57.445826 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.445760 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:27:57.446763 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.446743 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:27:57.446990 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.446957 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:27:57.447314 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.447297 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:27:57.447404 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.447355 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:27:57.447404 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.447389 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:27:57.663616 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.663590 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ztb8b"] Jun 07 16:27:57.666675 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:27:57.666652 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a251d10_e94f_4056_88a1_cc0c794b0278.slice/crio-64f1b4e888a0914dcb50a593a84f1d87b9d33e46d64a68217360ed4adb8eed4c WatchSource:0}: Error finding container 64f1b4e888a0914dcb50a593a84f1d87b9d33e46d64a68217360ed4adb8eed4c: Status 404 returned error can't find the container with id 64f1b4e888a0914dcb50a593a84f1d87b9d33e46d64a68217360ed4adb8eed4c Jun 07 16:27:57.737712 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.737515 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerStarted","Data":"e4aa9fe8ebd62c18917b2bcd015c8d438423d9176c439803ebdefaeaec16da0d"} Jun 07 16:27:57.738701 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:57.738675 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztb8b" event={"ID":"8a251d10-e94f-4056-88a1-cc0c794b0278","Type":"ContainerStarted","Data":"64f1b4e888a0914dcb50a593a84f1d87b9d33e46d64a68217360ed4adb8eed4c"} Jun 07 16:27:58.068316 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:58.068231 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:27:58.068463 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:58.068350 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:58.068463 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:27:58.068402 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:28:00.068389453 +0000 UTC m=+39.057280183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:27:58.743645 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:58.743612 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="e4aa9fe8ebd62c18917b2bcd015c8d438423d9176c439803ebdefaeaec16da0d" exitCode=0 Jun 07 16:27:58.743996 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:58.743673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"e4aa9fe8ebd62c18917b2bcd015c8d438423d9176c439803ebdefaeaec16da0d"} Jun 07 16:27:59.749230 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:59.749195 2571 generic.go:356] "Generic (PLEG): container finished" podID="a9ad68bc-9016-4ece-a165-e1788697d5ca" containerID="61b8354564d43f5c7b425f9abb4fe4c56d5b7e40e563598bef9f14ea547f007c" exitCode=0 Jun 07 16:27:59.749619 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:59.749280 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerDied","Data":"61b8354564d43f5c7b425f9abb4fe4c56d5b7e40e563598bef9f14ea547f007c"} Jun 07 16:27:59.750865 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:27:59.750841 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ztb8b" event={"ID":"8a251d10-e94f-4056-88a1-cc0c794b0278","Type":"ContainerStarted","Data":"a42281446138ef187e598aa5a733b1a88e549fe4399bde423dac67543fdf14e8"} Jun 07 16:28:00.084729 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:00.084687 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:28:00.084910 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:00.084878 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:00.084969 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:00.084958 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:28:04.084941912 +0000 UTC m=+43.073832641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:28:00.756610 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:00.756576 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hstwv" event={"ID":"a9ad68bc-9016-4ece-a165-e1788697d5ca","Type":"ContainerStarted","Data":"9c7ecbe9aefbd1f2f94fca59edfba870219a5b5fc8d3bc6ad2a42508df152244"} Jun 07 16:28:00.784177 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:00.784115 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ztb8b" podStartSLOduration=2.822309239 podStartE2EDuration="4.784078722s" totalImagesPullingTime="1.961769483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:59.784976374 +0000 UTC m=+38.773867128" watchObservedRunningTime="2026-06-07 16:28:00.784078722 +0000 UTC m=+39.772969465" Jun 07 16:28:00.784323 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:00.784300 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hstwv" podStartSLOduration=9.482136327 podStartE2EDuration="39.784293206s" totalImagesPullingTime="30.302156879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:00.782575955 +0000 UTC m=+39.771466718" watchObservedRunningTime="2026-06-07 16:28:00.784293206 +0000 UTC m=+39.773183957" Jun 07 16:28:04.112472 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:04.112439 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:28:04.112860 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:04.112542 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:04.112860 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:04.112595 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:28:12.112580021 +0000 UTC m=+51.101470753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:28:12.168589 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:12.168551 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:28:12.169136 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:12.168675 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:12.169136 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:12.168763 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:28:28.168749936 +0000 UTC m=+67.157640667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:28:23.736511 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:23.736483 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9787q" Jun 07 16:28:26.159338 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.159291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:28:26.161982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.161965 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:28:26.173471 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.173449 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a8596a-458b-4209-a487-f7c983032b79-original-pull-secret\") pod \"global-pull-secret-syncer-cm5mb\" (UID: \"d5a8596a-458b-4209-a487-f7c983032b79\") " pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:28:26.259968 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.259930 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:28:26.260138 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.259987 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:28:26.262565 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.262546 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:28:26.262678 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.262663 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:28:26.270447 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:26.270427 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:28:26.270529 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.270426 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm5mb" Jun 07 16:28:26.270529 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:26.270496 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:29:30.270475893 +0000 UTC m=+129.259366626 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : secret "metrics-daemon-secret" not found Jun 07 16:28:26.272636 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.272620 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:28:26.283444 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.283419 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bq2\" (UniqueName: \"kubernetes.io/projected/80f7442e-0f85-4627-ac43-d5aff3e2effe-kube-api-access-l7bq2\") pod \"network-check-target-qx6fz\" (UID: \"80f7442e-0f85-4627-ac43-d5aff3e2effe\") " pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:28:26.389328 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.389301 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cm5mb"] Jun 07 16:28:26.392593 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:28:26.392569 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a8596a_458b_4209_a487_f7c983032b79.slice/crio-ac52ea8b1713f16d1277d3be7d5a3f6e930ce35d45a3240c12cde880a8b3817e WatchSource:0}: Error finding container ac52ea8b1713f16d1277d3be7d5a3f6e930ce35d45a3240c12cde880a8b3817e: Status 404 returned error can't find the container with id ac52ea8b1713f16d1277d3be7d5a3f6e930ce35d45a3240c12cde880a8b3817e Jun 07 16:28:26.559626 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.559595 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:28:26.567871 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.567849 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:28:26.707258 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.707228 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qx6fz"] Jun 07 16:28:26.710317 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:28:26.710294 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f7442e_0f85_4627_ac43_d5aff3e2effe.slice/crio-1baab53d24f3243a375e5f68f484c823430cc91bcc5753d8564b7f9110748244 WatchSource:0}: Error finding container 1baab53d24f3243a375e5f68f484c823430cc91bcc5753d8564b7f9110748244: Status 404 returned error can't find the container with id 1baab53d24f3243a375e5f68f484c823430cc91bcc5753d8564b7f9110748244 Jun 07 16:28:26.820373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.820294 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qx6fz" event={"ID":"80f7442e-0f85-4627-ac43-d5aff3e2effe","Type":"ContainerStarted","Data":"1baab53d24f3243a375e5f68f484c823430cc91bcc5753d8564b7f9110748244"} Jun 07 16:28:26.821264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:26.821234 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cm5mb" event={"ID":"d5a8596a-458b-4209-a487-f7c983032b79","Type":"ContainerStarted","Data":"ac52ea8b1713f16d1277d3be7d5a3f6e930ce35d45a3240c12cde880a8b3817e"} Jun 07 16:28:28.174090 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:28.174047 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:28:28.174552 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:28.174214 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:28.174552 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:28:28.174290 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:29:00.174268255 +0000 UTC m=+99.163158988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:28:31.836855 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:31.836791 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qx6fz" event={"ID":"80f7442e-0f85-4627-ac43-d5aff3e2effe","Type":"ContainerStarted","Data":"087a9f27fb09967d7bcaec02cd0d6d6126d0a65c2e74fa760a6d80ee0676e8c5"} Jun 07 16:28:31.837303 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:31.836905 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:28:31.838139 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:31.838115 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cm5mb" event={"ID":"d5a8596a-458b-4209-a487-f7c983032b79","Type":"ContainerStarted","Data":"f6a3e4dd3425abc6d8d9c28c346683933295bac0ab350bfa8bd374f4f52b3112"} Jun 07 16:28:31.851855 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:31.851789 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qx6fz" podStartSLOduration=66.463795386 podStartE2EDuration="1m10.851776049s" totalImagesPullingTime="4.387980663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:31.851164611 +0000 UTC m=+70.840055364" watchObservedRunningTime="2026-06-07 16:28:31.851776049 +0000 UTC m=+70.840666800" Jun 07 16:28:31.864201 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:28:31.864159 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cm5mb" podStartSLOduration=66.153645133 podStartE2EDuration="1m10.864148278s" totalImagesPullingTime="4.710503145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:31.86413238 +0000 UTC m=+70.853023136" watchObservedRunningTime="2026-06-07 16:28:31.864148278 +0000 UTC m=+70.853039029" Jun 07 16:29:00.184972 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:29:00.184832 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:29:00.184972 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:29:00.184962 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:29:00.185469 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:29:00.185028 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:30:04.185011157 +0000 UTC m=+163.173901887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:29:02.858552 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:29:02.858519 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qx6fz" Jun 07 16:29:30.286089 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:29:30.286045 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:29:30.286574 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:29:30.286168 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:29:30.286574 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:29:30.286235 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs podName:dd705cc3-6364-405b-9ab7-6e7b18b350f6 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:32.286218786 +0000 UTC m=+251.275109539 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs") pod "network-metrics-daemon-g7f8s" (UID: "dd705cc3-6364-405b-9ab7-6e7b18b350f6") : secret "metrics-daemon-secret" not found Jun 07 16:29:59.390164 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:29:59.390126 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5hhm" podUID="1d9f052d-7795-4e0a-8612-3dc9c772605a" Jun 07 16:30:00.040630 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:00.040600 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:30:00.463949 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:00.463912 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g7f8s" podUID="dd705cc3-6364-405b-9ab7-6e7b18b350f6" Jun 07 16:30:04.208094 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:04.208012 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:30:04.208453 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:04.208119 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:30:04.208453 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:04.208178 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls podName:1d9f052d-7795-4e0a-8612-3dc9c772605a nodeName:}" failed. No retries permitted until 2026-06-07 16:32:06.208163323 +0000 UTC m=+285.197054054 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls") pod "dns-default-b5hhm" (UID: "1d9f052d-7795-4e0a-8612-3dc9c772605a") : secret "dns-default-metrics-tls" not found Jun 07 16:30:12.441328 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:12.441300 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:30:25.122757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.122722 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb"] Jun 07 16:30:25.125590 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.125565 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-xlzb2"] Jun 07 16:30:25.125728 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.125650 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.128249 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128231 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pp552"] Jun 07 16:30:25.128356 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128260 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 07 16:30:25.128356 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128306 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.128680 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128661 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-phnmr\"" Jun 07 16:30:25.128753 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128715 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 07 16:30:25.128753 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128745 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.128893 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.128819 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.130335 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130318 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-frbsw\"" Jun 07 16:30:25.130573 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130558 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.130670 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130640 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.130757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130739 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 07 16:30:25.130836 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130744 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 07 16:30:25.130984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.130970 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f75767cf5-gqgpp"] Jun 07 16:30:25.131114 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.131088 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.133883 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.133866 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.134290 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.134273 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 07 16:30:25.134385 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.134317 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7k5f2\"" Jun 07 16:30:25.134448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.134317 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 07 16:30:25.139047 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.139022 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 07 16:30:25.140264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140029 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 07 16:30:25.140264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140074 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 07 16:30:25.140264 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140147 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dtdhd\"" Jun 07 16:30:25.140461 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140269 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 07 16:30:25.140518 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140476 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.140681 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140661 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 07 16:30:25.140764 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.140708 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.142575 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.142493 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb"] Jun 07 16:30:25.143921 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.143921 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143830 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-stats-auth\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.143921 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143860 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-snapshots\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.143921 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-tmp\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.143921 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143915 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqp4w\" (UniqueName: \"kubernetes.io/projected/2a5337ba-2832-4e97-8730-5fac0b5cae54-kube-api-access-bqp4w\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143938 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99af884d-1829-4d1b-b51c-761b76432a28-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zns45\" (UniqueName: \"kubernetes.io/projected/5c1ac630-e1d5-42bd-8308-33fac4d53a89-kube-api-access-zns45\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.143986 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-default-certificate\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144010 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-trusted-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-service-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144133 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99af884d-1829-4d1b-b51c-761b76432a28-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144172 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sp9\" (UniqueName: \"kubernetes.io/projected/99af884d-1829-4d1b-b51c-761b76432a28-kube-api-access-75sp9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144199 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144221 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07011e4e-352f-4148-a8ad-2bdedb5de004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144246 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c1ac630-e1d5-42bd-8308-33fac4d53a89-serving-cert\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.144389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144290 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xlzb2"] Jun 07 16:30:25.146104 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.144432 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pp552"] Jun 07 16:30:25.146104 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.145568 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f75767cf5-gqgpp"] Jun 07 16:30:25.226419 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.226385 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn"] Jun 07 16:30:25.229209 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.229194 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg"] Jun 07 16:30:25.229331 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.229316 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" Jun 07 16:30:25.231565 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.231546 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lgrwq\"" Jun 07 16:30:25.231950 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.231935 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.234066 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.234045 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:30:25.234218 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.234197 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 07 16:30:25.234302 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.234237 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 07 16:30:25.234487 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.234474 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pm66w\"" Jun 07 16:30:25.239116 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.239100 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn"] Jun 07 16:30:25.239930 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.239910 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg"] Jun 07 16:30:25.244997 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.244976 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdg9z\" (UniqueName: \"kubernetes.io/projected/bd203ecf-9879-4e34-b267-8932cd9db283-kube-api-access-mdg9z\") pod \"network-check-source-dbd9cf844-5g8mn\" (UID: \"bd203ecf-9879-4e34-b267-8932cd9db283\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" Jun 07 16:30:25.245076 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245019 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99af884d-1829-4d1b-b51c-761b76432a28-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.245076 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245043 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sp9\" (UniqueName: \"kubernetes.io/projected/99af884d-1829-4d1b-b51c-761b76432a28-kube-api-access-75sp9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.245147 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245086 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.245147 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245107 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07011e4e-352f-4148-a8ad-2bdedb5de004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.245147 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245127 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkp2k\" (UniqueName: \"kubernetes.io/projected/946fc4f2-0119-4a29-b3b6-2352d0b5711b-kube-api-access-lkp2k\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.245289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245156 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c1ac630-e1d5-42bd-8308-33fac4d53a89-serving-cert\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.245289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245204 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.245289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245253 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-stats-auth\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.245289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245287 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-snapshots\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.245210 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.245304 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:25.7452841 +0000 UTC m=+184.734174831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.245372 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:25.745353561 +0000 UTC m=+184.734244293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : secret "router-metrics-certs-default" not found Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-tmp\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245431 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqp4w\" (UniqueName: \"kubernetes.io/projected/2a5337ba-2832-4e97-8730-5fac0b5cae54-kube-api-access-bqp4w\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.245477 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245455 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99af884d-1829-4d1b-b51c-761b76432a28-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245481 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245514 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zns45\" (UniqueName: \"kubernetes.io/projected/5c1ac630-e1d5-42bd-8308-33fac4d53a89-kube-api-access-zns45\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245539 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-default-certificate\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245595 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-trusted-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.245783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245620 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-service-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.246088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.245922 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07011e4e-352f-4148-a8ad-2bdedb5de004-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.246143 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.246111 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-snapshots\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.246143 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.246120 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1ac630-e1d5-42bd-8308-33fac4d53a89-tmp\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.246246 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.246231 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:25.246352 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.246337 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:25.746294642 +0000 UTC m=+184.735185383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:25.246422 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.246367 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-service-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.246620 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.246601 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99af884d-1829-4d1b-b51c-761b76432a28-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.247228 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.247181 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c1ac630-e1d5-42bd-8308-33fac4d53a89-trusted-ca-bundle\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.247603 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.247578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c1ac630-e1d5-42bd-8308-33fac4d53a89-serving-cert\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.247719 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.247702 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99af884d-1829-4d1b-b51c-761b76432a28-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.248212 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.248184 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-stats-auth\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.248490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.248473 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-default-certificate\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.261313 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.261295 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zns45\" (UniqueName: \"kubernetes.io/projected/5c1ac630-e1d5-42bd-8308-33fac4d53a89-kube-api-access-zns45\") pod \"insights-operator-896549976-xlzb2\" (UID: \"5c1ac630-e1d5-42bd-8308-33fac4d53a89\") " pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.261425 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.261323 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqp4w\" (UniqueName: \"kubernetes.io/projected/2a5337ba-2832-4e97-8730-5fac0b5cae54-kube-api-access-bqp4w\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.261486 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.261453 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sp9\" (UniqueName: \"kubernetes.io/projected/99af884d-1829-4d1b-b51c-761b76432a28-kube-api-access-75sp9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-bwzjb\" (UID: \"99af884d-1829-4d1b-b51c-761b76432a28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.345951 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.345923 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.346061 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.345972 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdg9z\" (UniqueName: \"kubernetes.io/projected/bd203ecf-9879-4e34-b267-8932cd9db283-kube-api-access-mdg9z\") pod \"network-check-source-dbd9cf844-5g8mn\" (UID: \"bd203ecf-9879-4e34-b267-8932cd9db283\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" Jun 07 16:30:25.346101 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.346055 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:30:25.346133 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.346111 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkp2k\" (UniqueName: \"kubernetes.io/projected/946fc4f2-0119-4a29-b3b6-2352d0b5711b-kube-api-access-lkp2k\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.346133 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.346121 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls podName:946fc4f2-0119-4a29-b3b6-2352d0b5711b nodeName:}" failed. No retries permitted until 2026-06-07 16:30:25.846105053 +0000 UTC m=+184.834995785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xr5kg" (UID: "946fc4f2-0119-4a29-b3b6-2352d0b5711b") : secret "samples-operator-tls" not found Jun 07 16:30:25.360020 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.359994 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkp2k\" (UniqueName: \"kubernetes.io/projected/946fc4f2-0119-4a29-b3b6-2352d0b5711b-kube-api-access-lkp2k\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.360109 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.360048 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdg9z\" (UniqueName: \"kubernetes.io/projected/bd203ecf-9879-4e34-b267-8932cd9db283-kube-api-access-mdg9z\") pod \"network-check-source-dbd9cf844-5g8mn\" (UID: \"bd203ecf-9879-4e34-b267-8932cd9db283\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" Jun 07 16:30:25.436361 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.436307 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" Jun 07 16:30:25.448289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.448271 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xlzb2" Jun 07 16:30:25.538316 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.538280 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" Jun 07 16:30:25.573280 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.573246 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb"] Jun 07 16:30:25.578214 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:25.578184 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99af884d_1829_4d1b_b51c_761b76432a28.slice/crio-de60b015298178a07ffd5a7d00a15938ddffa49a7f4303735edeb7e5530f6756 WatchSource:0}: Error finding container de60b015298178a07ffd5a7d00a15938ddffa49a7f4303735edeb7e5530f6756: Status 404 returned error can't find the container with id de60b015298178a07ffd5a7d00a15938ddffa49a7f4303735edeb7e5530f6756 Jun 07 16:30:25.587721 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.587697 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xlzb2"] Jun 07 16:30:25.592082 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:25.591562 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1ac630_e1d5_42bd_8308_33fac4d53a89.slice/crio-da519c92b69b801badd025936eb48167e52a091d496b3f75d7767793b1259021 WatchSource:0}: Error finding container da519c92b69b801badd025936eb48167e52a091d496b3f75d7767793b1259021: Status 404 returned error can't find the container with id da519c92b69b801badd025936eb48167e52a091d496b3f75d7767793b1259021 Jun 07 16:30:25.663427 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.663398 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn"] Jun 07 16:30:25.665959 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:25.665933 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd203ecf_9879_4e34_b267_8932cd9db283.slice/crio-7af1d9b6c5778f95ca5ec99b742a7f8d81abe8ceabe2262b33e54b197b3d004e WatchSource:0}: Error finding container 7af1d9b6c5778f95ca5ec99b742a7f8d81abe8ceabe2262b33e54b197b3d004e: Status 404 returned error can't find the container with id 7af1d9b6c5778f95ca5ec99b742a7f8d81abe8ceabe2262b33e54b197b3d004e Jun 07 16:30:25.750947 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.750922 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.751090 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.750967 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:25.751090 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.751024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:25.751090 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.751076 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:30:25.751228 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.751136 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.751118693 +0000 UTC m=+185.740009423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : secret "router-metrics-certs-default" not found Jun 07 16:30:25.751228 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.751142 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:25.751228 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.751152 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.751146155 +0000 UTC m=+185.740036885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:25.751228 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.751188 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.751172329 +0000 UTC m=+185.740063064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:25.851907 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:25.851872 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:25.852045 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.851979 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:30:25.852045 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:25.852026 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls podName:946fc4f2-0119-4a29-b3b6-2352d0b5711b nodeName:}" failed. No retries permitted until 2026-06-07 16:30:26.852014596 +0000 UTC m=+185.840905326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xr5kg" (UID: "946fc4f2-0119-4a29-b3b6-2352d0b5711b") : secret "samples-operator-tls" not found Jun 07 16:30:26.099765 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.099724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" event={"ID":"bd203ecf-9879-4e34-b267-8932cd9db283","Type":"ContainerStarted","Data":"25d0c423198f3ab8fd1b66bc832efacf0ce4dba43817895ea8bb792470994ebc"} Jun 07 16:30:26.099960 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.099782 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" event={"ID":"bd203ecf-9879-4e34-b267-8932cd9db283","Type":"ContainerStarted","Data":"7af1d9b6c5778f95ca5ec99b742a7f8d81abe8ceabe2262b33e54b197b3d004e"} Jun 07 16:30:26.101031 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.101004 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xlzb2" event={"ID":"5c1ac630-e1d5-42bd-8308-33fac4d53a89","Type":"ContainerStarted","Data":"da519c92b69b801badd025936eb48167e52a091d496b3f75d7767793b1259021"} Jun 07 16:30:26.102285 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.102259 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" event={"ID":"99af884d-1829-4d1b-b51c-761b76432a28","Type":"ContainerStarted","Data":"de60b015298178a07ffd5a7d00a15938ddffa49a7f4303735edeb7e5530f6756"} Jun 07 16:30:26.117777 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.117348 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5g8mn" podStartSLOduration=1.117329535 podStartE2EDuration="1.117329535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:26.116441239 +0000 UTC m=+185.105331992" watchObservedRunningTime="2026-06-07 16:30:26.117329535 +0000 UTC m=+185.106220292" Jun 07 16:30:26.760199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.760156 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:26.760666 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.760252 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:26.760666 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.760339 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:26.760666 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.760466 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:30:26.760666 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.760531 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:28.760511065 +0000 UTC m=+187.749401798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : secret "router-metrics-certs-default" not found Jun 07 16:30:26.760909 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.760890 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:26.760983 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.760951 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:28.760934382 +0000 UTC m=+187.749825117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:26.761042 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.760994 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:28.760977142 +0000 UTC m=+187.749867877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:26.861226 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:26.861191 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:26.861407 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.861367 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:30:26.861474 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:26.861446 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls podName:946fc4f2-0119-4a29-b3b6-2352d0b5711b nodeName:}" failed. No retries permitted until 2026-06-07 16:30:28.861424169 +0000 UTC m=+187.850314921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xr5kg" (UID: "946fc4f2-0119-4a29-b3b6-2352d0b5711b") : secret "samples-operator-tls" not found Jun 07 16:30:28.776813 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:28.776777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:28.776888 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:28.776925 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.776934 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.777009 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:32.77699094 +0000 UTC m=+191.765881686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.777031 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:32.777020859 +0000 UTC m=+191.765911589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.777042 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:30:28.777267 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.777107 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:32.777090886 +0000 UTC m=+191.765981619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : secret "router-metrics-certs-default" not found Jun 07 16:30:28.877563 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:28.877520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:28.877727 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.877671 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:30:28.877783 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:28.877753 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls podName:946fc4f2-0119-4a29-b3b6-2352d0b5711b nodeName:}" failed. No retries permitted until 2026-06-07 16:30:32.877731941 +0000 UTC m=+191.866622672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xr5kg" (UID: "946fc4f2-0119-4a29-b3b6-2352d0b5711b") : secret "samples-operator-tls" not found Jun 07 16:30:29.112342 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:29.112258 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xlzb2" event={"ID":"5c1ac630-e1d5-42bd-8308-33fac4d53a89","Type":"ContainerStarted","Data":"e8fd1922c52fd0f3b552ab4d73786679da81efc12aca4d8ed6354bcb3719bec8"} Jun 07 16:30:29.113708 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:29.113683 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" event={"ID":"99af884d-1829-4d1b-b51c-761b76432a28","Type":"ContainerStarted","Data":"86ee7b7a0b3d695c13227adbf5e959ea806fef5a321c1817383cbeeb3efa7298"} Jun 07 16:30:29.128279 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:29.128240 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-xlzb2" podStartSLOduration=1.609038091 podStartE2EDuration="4.128228595s" totalImagesPullingTime="2.519190504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:29.127769776 +0000 UTC m=+188.116660528" watchObservedRunningTime="2026-06-07 16:30:29.128228595 +0000 UTC m=+188.117119344" Jun 07 16:30:29.149436 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:29.149400 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" podStartSLOduration=1.618265993 podStartE2EDuration="4.149388045s" totalImagesPullingTime="2.531122052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:29.148839583 +0000 UTC m=+188.137730336" watchObservedRunningTime="2026-06-07 16:30:29.149388045 +0000 UTC m=+188.138278796" Jun 07 16:30:31.935697 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.935663 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8w4hs"] Jun 07 16:30:31.938551 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.938533 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:31.941106 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.941078 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 07 16:30:31.941230 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.941087 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 07 16:30:31.941987 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.941966 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-skfx9\"" Jun 07 16:30:31.941987 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.941982 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 07 16:30:31.942143 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.941990 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 07 16:30:31.945242 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:31.945216 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8w4hs"] Jun 07 16:30:32.005867 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.005836 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q477j\" (UniqueName: \"kubernetes.io/projected/55d88609-4c72-4d2e-b8b8-33f43b4c4071-kube-api-access-q477j\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.006016 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.005888 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-cabundle\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.006016 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.005904 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-key\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.106421 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.106394 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q477j\" (UniqueName: \"kubernetes.io/projected/55d88609-4c72-4d2e-b8b8-33f43b4c4071-kube-api-access-q477j\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.106555 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.106447 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-cabundle\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.106555 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.106471 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-key\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.107060 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.107043 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-cabundle\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.108958 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.108942 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/55d88609-4c72-4d2e-b8b8-33f43b4c4071-signing-key\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.114347 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.114317 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q477j\" (UniqueName: \"kubernetes.io/projected/55d88609-4c72-4d2e-b8b8-33f43b4c4071-kube-api-access-q477j\") pod \"service-ca-7d74d578b8-8w4hs\" (UID: \"55d88609-4c72-4d2e-b8b8-33f43b4c4071\") " pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.218820 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.218780 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpc55_f2945f93-8b68-4f02-ba8b-eb5c0a68e375/dns-node-resolver/0.log" Jun 07 16:30:32.248059 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.248034 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" Jun 07 16:30:32.366447 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.366416 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-8w4hs"] Jun 07 16:30:32.369238 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:32.369212 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d88609_4c72_4d2e_b8b8_33f43b4c4071.slice/crio-db0beaccf6c8dde4085c71abb16f403c8b81adf1b875cc99bf337c50e16da795 WatchSource:0}: Error finding container db0beaccf6c8dde4085c71abb16f403c8b81adf1b875cc99bf337c50e16da795: Status 404 returned error can't find the container with id db0beaccf6c8dde4085c71abb16f403c8b81adf1b875cc99bf337c50e16da795 Jun 07 16:30:32.812015 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.811973 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:32.812246 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.812093 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:32.812246 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.812137 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 07 16:30:32.812246 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.812143 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:32.812246 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.812205 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:40.81218924 +0000 UTC m=+199.801079970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : secret "router-metrics-certs-default" not found Jun 07 16:30:32.812453 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.812259 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:32.812453 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.812264 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:40.812246399 +0000 UTC m=+199.801137139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:32.812453 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.812303 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:40.812289303 +0000 UTC m=+199.801180033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:32.912693 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:32.912664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:32.912888 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.912860 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:30:32.912959 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:32.912937 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls podName:946fc4f2-0119-4a29-b3b6-2352d0b5711b nodeName:}" failed. No retries permitted until 2026-06-07 16:30:40.912918616 +0000 UTC m=+199.901809366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xr5kg" (UID: "946fc4f2-0119-4a29-b3b6-2352d0b5711b") : secret "samples-operator-tls" not found Jun 07 16:30:33.019894 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:33.019863 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p4v7_943eb10a-03c7-4fc3-a29f-1771d65b346e/node-ca/0.log" Jun 07 16:30:33.127253 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:33.127105 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" event={"ID":"55d88609-4c72-4d2e-b8b8-33f43b4c4071","Type":"ContainerStarted","Data":"db0beaccf6c8dde4085c71abb16f403c8b81adf1b875cc99bf337c50e16da795"} Jun 07 16:30:34.135647 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:34.135605 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" event={"ID":"55d88609-4c72-4d2e-b8b8-33f43b4c4071","Type":"ContainerStarted","Data":"83b26e02aa02924b8aac6ab7ae858def5072ddb89004fd8fd74cf10747ff03bc"} Jun 07 16:30:34.151464 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:34.151414 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-8w4hs" podStartSLOduration=1.50924973 podStartE2EDuration="3.151401071s" totalImagesPullingTime="1.642151341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:34.150521553 +0000 UTC m=+193.139412304" watchObservedRunningTime="2026-06-07 16:30:34.151401071 +0000 UTC m=+193.140291822" Jun 07 16:30:34.218906 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:34.218886 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztb8b_8a251d10-e94f-4056-88a1-cc0c794b0278/serve-healthcheck-canary/0.log" Jun 07 16:30:34.820230 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:34.820190 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwzjb_99af884d-1829-4d1b-b51c-761b76432a28/kube-storage-version-migrator-operator/0.log" Jun 07 16:30:40.874035 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.874004 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:40.874435 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.874051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:40.874435 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.874102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:40.874435 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:40.874178 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle podName:2a5337ba-2832-4e97-8730-5fac0b5cae54 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:56.874158749 +0000 UTC m=+215.863049482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle") pod "router-default-7f75767cf5-gqgpp" (UID: "2a5337ba-2832-4e97-8730-5fac0b5cae54") : configmap references non-existent config key: service-ca.crt Jun 07 16:30:40.874435 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:40.874241 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 16:30:40.874435 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:30:40.874311 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert podName:07011e4e-352f-4148-a8ad-2bdedb5de004 nodeName:}" failed. No retries permitted until 2026-06-07 16:30:56.874294218 +0000 UTC m=+215.863184953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-pp552" (UID: "07011e4e-352f-4148-a8ad-2bdedb5de004") : secret "networking-console-plugin-cert" not found Jun 07 16:30:40.876544 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.876518 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a5337ba-2832-4e97-8730-5fac0b5cae54-metrics-certs\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:40.975318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.975288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:40.977754 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:40.977727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/946fc4f2-0119-4a29-b3b6-2352d0b5711b-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xr5kg\" (UID: \"946fc4f2-0119-4a29-b3b6-2352d0b5711b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:41.144596 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:41.144522 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" Jun 07 16:30:41.266965 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:41.266935 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg"] Jun 07 16:30:42.161234 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:42.161197 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" event={"ID":"946fc4f2-0119-4a29-b3b6-2352d0b5711b","Type":"ContainerStarted","Data":"61309f3bea638d813776a60aaf63814d4b8c73b681644dbb641dd727864e33af"} Jun 07 16:30:44.171000 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:44.170964 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" event={"ID":"946fc4f2-0119-4a29-b3b6-2352d0b5711b","Type":"ContainerStarted","Data":"26aaf44600db916564bcf892993088902c3a29110565b9601eb17e190bcb0677"} Jun 07 16:30:44.171455 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:44.171018 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" event={"ID":"946fc4f2-0119-4a29-b3b6-2352d0b5711b","Type":"ContainerStarted","Data":"be624b7a576a8071c857e612812accd5ab152e4d374d87568b52bc16404b229c"} Jun 07 16:30:44.186730 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:44.186685 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xr5kg" podStartSLOduration=17.39754143 podStartE2EDuration="19.186672342s" totalImagesPullingTime="1.789130912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:44.185536301 +0000 UTC m=+203.174427053" watchObservedRunningTime="2026-06-07 16:30:44.186672342 +0000 UTC m=+203.175563143" Jun 07 16:30:53.502178 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.502149 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-hhsdr"] Jun 07 16:30:53.505582 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.505564 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:30:53.508192 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.508169 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vdc5w\"" Jun 07 16:30:53.508296 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.508180 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 16:30:53.508355 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.508302 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 16:30:53.515823 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.515783 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hhsdr"] Jun 07 16:30:53.530454 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.530433 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dgnm9"] Jun 07 16:30:53.532967 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.532953 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.536084 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.536063 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4dd7s\"" Jun 07 16:30:53.536186 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.536152 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:30:53.536290 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.536274 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:30:53.544154 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.544133 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgnm9"] Jun 07 16:30:53.553736 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.553717 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-977c8fc99-xgrrs"] Jun 07 16:30:53.556097 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.556078 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.558515 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.558496 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:30:53.558616 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.558595 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:30:53.558680 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.558619 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8v6gq\"" Jun 07 16:30:53.558734 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.558678 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:30:53.563029 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.563013 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:30:53.570399 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.570380 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-977c8fc99-xgrrs"] Jun 07 16:30:53.570693 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.570663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t4lh\" (UniqueName: \"kubernetes.io/projected/a045a83d-fa63-4631-8bb1-6c1fa4d4b342-kube-api-access-9t4lh\") pod \"downloads-6657875f97-hhsdr\" (UID: \"a045a83d-fa63-4631-8bb1-6c1fa4d4b342\") " pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:30:53.671685 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpfct\" (UniqueName: \"kubernetes.io/projected/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-api-access-zpfct\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.671844 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671717 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.671844 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.671844 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671832 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-image-registry-private-configuration\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.671978 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671851 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-trusted-ca\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.671978 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-crio-socket\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.671978 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671897 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3332e915-18fb-4877-8355-281204c1be35-ca-trust-extracted\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.671978 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671960 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-registry-tls\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.671995 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-bound-sa-token\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.672015 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t4lh\" (UniqueName: \"kubernetes.io/projected/a045a83d-fa63-4631-8bb1-6c1fa4d4b342-kube-api-access-9t4lh\") pod \"downloads-6657875f97-hhsdr\" (UID: \"a045a83d-fa63-4631-8bb1-6c1fa4d4b342\") " pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.672031 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-installation-pull-secrets\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.672048 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxfq\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-kube-api-access-4mxfq\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.672083 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-registry-certificates\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.672130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.672102 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-data-volume\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.682975 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.682954 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t4lh\" (UniqueName: \"kubernetes.io/projected/a045a83d-fa63-4631-8bb1-6c1fa4d4b342-kube-api-access-9t4lh\") pod \"downloads-6657875f97-hhsdr\" (UID: \"a045a83d-fa63-4631-8bb1-6c1fa4d4b342\") " pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:30:53.772630 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772542 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.772630 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772585 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-image-registry-private-configuration\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.772630 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772609 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-trusted-ca\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.772909 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772646 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-crio-socket\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.772909 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3332e915-18fb-4877-8355-281204c1be35-ca-trust-extracted\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.772909 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-registry-tls\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.772909 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772738 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-bound-sa-token\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.772909 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.772762 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-crio-socket\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.773199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3332e915-18fb-4877-8355-281204c1be35-ca-trust-extracted\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.773199 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773185 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-installation-pull-secrets\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.773304 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773225 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxfq\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-kube-api-access-4mxfq\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.773304 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773265 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-registry-certificates\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.773304 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773293 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-data-volume\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.773631 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773346 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfct\" (UniqueName: \"kubernetes.io/projected/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-api-access-zpfct\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.773631 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.773631 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773605 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-trusted-ca\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.773855 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.773796 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-data-volume\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.774224 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.774200 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.774371 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.774354 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3332e915-18fb-4877-8355-281204c1be35-registry-certificates\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.775353 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.775333 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-registry-tls\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.775452 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.775435 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.775549 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.775531 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-image-registry-private-configuration\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.775640 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.775621 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3332e915-18fb-4877-8355-281204c1be35-installation-pull-secrets\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.781685 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.781663 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpfct\" (UniqueName: \"kubernetes.io/projected/4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7-kube-api-access-zpfct\") pod \"insights-runtime-extractor-dgnm9\" (UID: \"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7\") " pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.781778 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.781719 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-bound-sa-token\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.782022 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.781998 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxfq\" (UniqueName: \"kubernetes.io/projected/3332e915-18fb-4877-8355-281204c1be35-kube-api-access-4mxfq\") pod \"image-registry-977c8fc99-xgrrs\" (UID: \"3332e915-18fb-4877-8355-281204c1be35\") " pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.814620 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.814600 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:30:53.841496 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.841468 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgnm9" Jun 07 16:30:53.865376 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.865339 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:53.957845 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.957764 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hhsdr"] Jun 07 16:30:53.961990 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:53.961958 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda045a83d_fa63_4631_8bb1_6c1fa4d4b342.slice/crio-1ba1f0756279b2f77f677451c5d2fa773ae2c06aaa97e48a3defb6caf0a69339 WatchSource:0}: Error finding container 1ba1f0756279b2f77f677451c5d2fa773ae2c06aaa97e48a3defb6caf0a69339: Status 404 returned error can't find the container with id 1ba1f0756279b2f77f677451c5d2fa773ae2c06aaa97e48a3defb6caf0a69339 Jun 07 16:30:53.983901 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:53.983873 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgnm9"] Jun 07 16:30:53.986455 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:53.986430 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b63e510_4f2c_4aa6_80ea_bbd84f55a5e7.slice/crio-90758e95aa920074f2615eb3787b885a7df3a0a165aaed68d9de082d454a5bba WatchSource:0}: Error finding container 90758e95aa920074f2615eb3787b885a7df3a0a165aaed68d9de082d454a5bba: Status 404 returned error can't find the container with id 90758e95aa920074f2615eb3787b885a7df3a0a165aaed68d9de082d454a5bba Jun 07 16:30:54.010019 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.009947 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-977c8fc99-xgrrs"] Jun 07 16:30:54.021776 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:54.021749 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3332e915_18fb_4877_8355_281204c1be35.slice/crio-b636cf2c3c7f465e380c331db87032b393a7e8b4f6c783b5622ea7e701e14feb WatchSource:0}: Error finding container b636cf2c3c7f465e380c331db87032b393a7e8b4f6c783b5622ea7e701e14feb: Status 404 returned error can't find the container with id b636cf2c3c7f465e380c331db87032b393a7e8b4f6c783b5622ea7e701e14feb Jun 07 16:30:54.205873 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.205833 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hhsdr" event={"ID":"a045a83d-fa63-4631-8bb1-6c1fa4d4b342","Type":"ContainerStarted","Data":"1ba1f0756279b2f77f677451c5d2fa773ae2c06aaa97e48a3defb6caf0a69339"} Jun 07 16:30:54.207376 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.207351 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" event={"ID":"3332e915-18fb-4877-8355-281204c1be35","Type":"ContainerStarted","Data":"ff502b0a541b903f46262665d814b58e6d1f6261b58c96432cd2352c72764dc0"} Jun 07 16:30:54.207498 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.207390 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" event={"ID":"3332e915-18fb-4877-8355-281204c1be35","Type":"ContainerStarted","Data":"b636cf2c3c7f465e380c331db87032b393a7e8b4f6c783b5622ea7e701e14feb"} Jun 07 16:30:54.207574 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.207537 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:30:54.208923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.208900 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgnm9" event={"ID":"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7","Type":"ContainerStarted","Data":"697d01145b1bbedda1e06352ba2ffdc1ab60d130f260a7990e49b9de7ae61188"} Jun 07 16:30:54.209033 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.208940 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgnm9" event={"ID":"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7","Type":"ContainerStarted","Data":"90758e95aa920074f2615eb3787b885a7df3a0a165aaed68d9de082d454a5bba"} Jun 07 16:30:54.224929 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:54.224884 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podStartSLOduration=1.224870137 podStartE2EDuration="1.224870137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:54.224004566 +0000 UTC m=+213.212895318" watchObservedRunningTime="2026-06-07 16:30:54.224870137 +0000 UTC m=+213.213760883" Jun 07 16:30:55.214331 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:55.214296 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgnm9" event={"ID":"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7","Type":"ContainerStarted","Data":"5fb6c6a6c848c2ec8b7ba8d9fb1dcce29330743f5dd8573a85f1230cdf4a5f93"} Jun 07 16:30:56.900836 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.900792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:56.900836 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.900846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:56.901605 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.901578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5337ba-2832-4e97-8730-5fac0b5cae54-service-ca-bundle\") pod \"router-default-7f75767cf5-gqgpp\" (UID: \"2a5337ba-2832-4e97-8730-5fac0b5cae54\") " pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:56.903526 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.903503 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07011e4e-352f-4148-a8ad-2bdedb5de004-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-pp552\" (UID: \"07011e4e-352f-4148-a8ad-2bdedb5de004\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:56.954506 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.954452 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" Jun 07 16:30:56.959763 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:56.959744 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:57.104989 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.104956 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f75767cf5-gqgpp"] Jun 07 16:30:57.108442 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:57.108405 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5337ba_2832_4e97_8730_5fac0b5cae54.slice/crio-5c6291659bc0bf36d961de1cc8a379e3d986e147997d05015af0a2951c9ea27c WatchSource:0}: Error finding container 5c6291659bc0bf36d961de1cc8a379e3d986e147997d05015af0a2951c9ea27c: Status 404 returned error can't find the container with id 5c6291659bc0bf36d961de1cc8a379e3d986e147997d05015af0a2951c9ea27c Jun 07 16:30:57.125640 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.125581 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-pp552"] Jun 07 16:30:57.128615 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:57.128587 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07011e4e_352f_4148_a8ad_2bdedb5de004.slice/crio-f13ed428af87fde6febebfa3262e20e4885df4b22b70c4b225db5e05627a6897 WatchSource:0}: Error finding container f13ed428af87fde6febebfa3262e20e4885df4b22b70c4b225db5e05627a6897: Status 404 returned error can't find the container with id f13ed428af87fde6febebfa3262e20e4885df4b22b70c4b225db5e05627a6897 Jun 07 16:30:57.224406 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.224371 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" event={"ID":"2a5337ba-2832-4e97-8730-5fac0b5cae54","Type":"ContainerStarted","Data":"1cfdfc8f0a90906a2606f273aee184a9a1f89dbcbd4173363c540100831060fe"} Jun 07 16:30:57.224581 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.224433 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" event={"ID":"2a5337ba-2832-4e97-8730-5fac0b5cae54","Type":"ContainerStarted","Data":"5c6291659bc0bf36d961de1cc8a379e3d986e147997d05015af0a2951c9ea27c"} Jun 07 16:30:57.225588 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.225562 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" event={"ID":"07011e4e-352f-4148-a8ad-2bdedb5de004","Type":"ContainerStarted","Data":"f13ed428af87fde6febebfa3262e20e4885df4b22b70c4b225db5e05627a6897"} Jun 07 16:30:57.227945 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.227894 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgnm9" event={"ID":"4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7","Type":"ContainerStarted","Data":"b06bbcf9fb82de1882add4287319bdf26115a507dd410b51a080078039a754c1"} Jun 07 16:30:57.242589 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.242537 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" podStartSLOduration=32.242519405 podStartE2EDuration="32.242519405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:57.24103288 +0000 UTC m=+216.229923631" watchObservedRunningTime="2026-06-07 16:30:57.242519405 +0000 UTC m=+216.231410155" Jun 07 16:30:57.960891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.960853 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:57.963579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.963520 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:57.982179 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:57.982133 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dgnm9" podStartSLOduration=2.671887232 podStartE2EDuration="4.982113914s" totalImagesPullingTime="2.310226682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:30:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:57.257390872 +0000 UTC m=+216.246281627" watchObservedRunningTime="2026-06-07 16:30:57.982113914 +0000 UTC m=+216.971004667" Jun 07 16:30:58.233261 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:58.233154 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:58.234569 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:58.234545 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f75767cf5-gqgpp" Jun 07 16:30:59.237676 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.237638 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" event={"ID":"07011e4e-352f-4148-a8ad-2bdedb5de004","Type":"ContainerStarted","Data":"67f9d9c7aa675902f79cf8e0a2d061d68f27f5cbec6ffe8fc8b06ad11f2e30f4"} Jun 07 16:30:59.254071 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.254024 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-pp552" podStartSLOduration=32.896536679 podStartE2EDuration="34.254006852s" totalImagesPullingTime="1.357470173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:59.25198847 +0000 UTC m=+218.240879225" watchObservedRunningTime="2026-06-07 16:30:59.254006852 +0000 UTC m=+218.242897604" Jun 07 16:30:59.512247 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.512166 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:30:59.517339 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.517317 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.519844 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.519815 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 16:30:59.519951 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.519818 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 16:30:59.521053 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.520870 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 16:30:59.521053 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.520947 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 16:30:59.521053 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.520947 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bv9pz\"" Jun 07 16:30:59.521053 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.520973 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 16:30:59.524334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.524310 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:30:59.619590 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619560 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.619743 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619596 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.619743 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619636 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp9p9\" (UniqueName: \"kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.619743 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.619743 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619719 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.619934 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.619791 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720416 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720385 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720416 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720417 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720451 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp9p9\" (UniqueName: \"kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720499 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.720600 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.720565 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.721409 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.721382 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.721535 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.721382 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.721535 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.721439 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.723387 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.723355 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.723486 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.723404 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.730109 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.730083 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp9p9\" (UniqueName: \"kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9\") pod \"console-697c89d95c-nsd9k\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.829448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.829366 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:30:59.978579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:30:59.978549 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:30:59.982077 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:30:59.982047 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aff06ae_31f1_43e5_a70d_7be78a0e279f.slice/crio-e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c WatchSource:0}: Error finding container e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c: Status 404 returned error can't find the container with id e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c Jun 07 16:31:00.246830 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:00.246772 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697c89d95c-nsd9k" event={"ID":"3aff06ae-31f1-43e5-a70d-7be78a0e279f","Type":"ContainerStarted","Data":"e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c"} Jun 07 16:31:04.264008 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:04.263877 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697c89d95c-nsd9k" event={"ID":"3aff06ae-31f1-43e5-a70d-7be78a0e279f","Type":"ContainerStarted","Data":"dc4a68c580c1aa8b6ebdb8128692abcd3617e76de70411547c93959bc48cd862"} Jun 07 16:31:04.280979 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:04.280918 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697c89d95c-nsd9k" podStartSLOduration=1.981737479 podStartE2EDuration="5.280902261s" totalImagesPullingTime="3.299164782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:04.27933653 +0000 UTC m=+223.268227307" watchObservedRunningTime="2026-06-07 16:31:04.280902261 +0000 UTC m=+223.269793015" Jun 07 16:31:07.888661 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.888627 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:31:07.891370 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.891349 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.899160 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.899136 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 16:31:07.900628 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.900577 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:31:07.986733 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986697 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.986923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986758 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.986923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986825 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.986923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986850 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.986923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.986923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986920 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:07.987139 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:07.986948 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6gln\" (UniqueName: \"kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.087920 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.087886 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.087946 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.087973 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.087991 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.088037 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.088062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088088 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.088088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6gln\" (UniqueName: \"kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088738 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.088710 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.088866 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.088753 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.089053 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.089018 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.089147 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.089126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.091276 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.091257 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.091389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.091363 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.096438 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.096414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6gln\" (UniqueName: \"kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln\") pod \"console-8696c8ddf8-m7ckb\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.202448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.202264 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:08.513312 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.513239 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rpn4s"] Jun 07 16:31:08.520274 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.520251 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.523466 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.523005 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:31:08.523466 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.523094 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:31:08.523466 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.523303 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:31:08.523466 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.523313 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wsm7l\"" Jun 07 16:31:08.523954 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.523510 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:31:08.531731 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.530158 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:31:08.531731 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.531353 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:31:08.591326 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591299 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591462 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-metrics-client-ca\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591462 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591426 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nf9j\" (UniqueName: \"kubernetes.io/projected/b300f8f1-5edb-4654-b015-d27573f004fc-kube-api-access-7nf9j\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591577 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591577 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-wtmp\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591577 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591534 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-sys\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591577 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591559 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-textfile\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591775 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591587 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.591775 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.591626 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-root\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692673 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692683 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-wtmp\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-sys\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692752 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-textfile\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692840 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-root\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.692870 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692867 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.693176 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692896 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-metrics-client-ca\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.693176 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.692964 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nf9j\" (UniqueName: \"kubernetes.io/projected/b300f8f1-5edb-4654-b015-d27573f004fc-kube-api-access-7nf9j\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.693378 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.693339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-root\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.693499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-textfile\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.693524 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-wtmp\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.693569 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b300f8f1-5edb-4654-b015-d27573f004fc-sys\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:31:08.693625 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:31:08.693696 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls podName:b300f8f1-5edb-4654-b015-d27573f004fc nodeName:}" failed. No retries permitted until 2026-06-07 16:31:09.19367597 +0000 UTC m=+228.182566713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls") pod "node-exporter-rpn4s" (UID: "b300f8f1-5edb-4654-b015-d27573f004fc") : secret "node-exporter-tls" not found Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.693904 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-accelerators-collector-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.694085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.694043 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b300f8f1-5edb-4654-b015-d27573f004fc-metrics-client-ca\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.696022 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.695990 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:08.702065 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:08.702022 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nf9j\" (UniqueName: \"kubernetes.io/projected/b300f8f1-5edb-4654-b015-d27573f004fc-kube-api-access-7nf9j\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:09.197726 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.197683 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:09.200399 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.200374 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b300f8f1-5edb-4654-b015-d27573f004fc-node-exporter-tls\") pod \"node-exporter-rpn4s\" (UID: \"b300f8f1-5edb-4654-b015-d27573f004fc\") " pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:09.444730 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.444700 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rpn4s" Jun 07 16:31:09.829871 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.829834 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:31:09.830064 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.829938 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:31:09.831585 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.831548 2571 patch_prober.go:28] interesting pod/console-697c89d95c-nsd9k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 07 16:31:09.831711 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:09.831617 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-697c89d95c-nsd9k" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 07 16:31:10.365850 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:31:10.365822 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb300f8f1_5edb_4654_b015_d27573f004fc.slice/crio-1e6482eab58c913de3d77a4a7816111f98d7bc9b4ad0931e42bde51265973aec WatchSource:0}: Error finding container 1e6482eab58c913de3d77a4a7816111f98d7bc9b4ad0931e42bde51265973aec: Status 404 returned error can't find the container with id 1e6482eab58c913de3d77a4a7816111f98d7bc9b4ad0931e42bde51265973aec Jun 07 16:31:10.500046 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:10.500019 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:31:10.503556 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:31:10.503445 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662429b0_a5a4_4d9e_b064_d5e1b9adcc23.slice/crio-05525cbea0abbf80ca6562cb861db896e878471c85360693333589912422687f WatchSource:0}: Error finding container 05525cbea0abbf80ca6562cb861db896e878471c85360693333589912422687f: Status 404 returned error can't find the container with id 05525cbea0abbf80ca6562cb861db896e878471c85360693333589912422687f Jun 07 16:31:11.290191 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.290154 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rpn4s" event={"ID":"b300f8f1-5edb-4654-b015-d27573f004fc","Type":"ContainerStarted","Data":"1e6482eab58c913de3d77a4a7816111f98d7bc9b4ad0931e42bde51265973aec"} Jun 07 16:31:11.292333 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.292282 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8696c8ddf8-m7ckb" event={"ID":"662429b0-a5a4-4d9e-b064-d5e1b9adcc23","Type":"ContainerStarted","Data":"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f"} Jun 07 16:31:11.292442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.292337 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8696c8ddf8-m7ckb" event={"ID":"662429b0-a5a4-4d9e-b064-d5e1b9adcc23","Type":"ContainerStarted","Data":"05525cbea0abbf80ca6562cb861db896e878471c85360693333589912422687f"} Jun 07 16:31:11.294473 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.294128 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hhsdr" event={"ID":"a045a83d-fa63-4631-8bb1-6c1fa4d4b342","Type":"ContainerStarted","Data":"a8a48bfaabbf36f5531452f748ea1205c59a3fda56033939147e6c54dc84a919"} Jun 07 16:31:11.294473 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.294302 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:31:11.305726 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.305706 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-hhsdr" Jun 07 16:31:11.309562 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.309515 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8696c8ddf8-m7ckb" podStartSLOduration=4.309497629 podStartE2EDuration="4.309497629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:11.308464861 +0000 UTC m=+230.297355610" watchObservedRunningTime="2026-06-07 16:31:11.309497629 +0000 UTC m=+230.298388383" Jun 07 16:31:11.323342 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:11.323297 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-hhsdr" podStartSLOduration=1.8225671490000002 podStartE2EDuration="18.323280647s" totalImagesPullingTime="16.500713498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:11.322646928 +0000 UTC m=+230.311537693" watchObservedRunningTime="2026-06-07 16:31:11.323280647 +0000 UTC m=+230.312171399" Jun 07 16:31:12.307247 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.307203 2571 generic.go:356] "Generic (PLEG): container finished" podID="b300f8f1-5edb-4654-b015-d27573f004fc" containerID="ff73ddb540f797d30c50bfec412771925c81daad2b018f7c1dae1466c91dafd1" exitCode=0 Jun 07 16:31:12.307730 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.307307 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rpn4s" event={"ID":"b300f8f1-5edb-4654-b015-d27573f004fc","Type":"ContainerDied","Data":"ff73ddb540f797d30c50bfec412771925c81daad2b018f7c1dae1466c91dafd1"} Jun 07 16:31:12.818225 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.818189 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-557ccdc645-bnh9n"] Jun 07 16:31:12.841707 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.841675 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-557ccdc645-bnh9n"] Jun 07 16:31:12.841891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.841767 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.844744 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.844479 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 07 16:31:12.844744 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.844514 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 07 16:31:12.844744 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.844524 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 07 16:31:12.845448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.845426 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jdr5w\"" Jun 07 16:31:12.845546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.845426 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2m4jli52uatje\"" Jun 07 16:31:12.845546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.845503 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 07 16:31:12.934683 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.934644 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.934891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.934706 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bjlg\" (UniqueName: \"kubernetes.io/projected/8578cdb2-9cf0-4abb-9206-5909b01add1f-kube-api-access-9bjlg\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.934891 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.934814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-client-certs\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.935009 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.934928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-client-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.935009 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.934968 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-tls\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.935101 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.935011 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-metrics-server-audit-profiles\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:12.935101 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:12.935042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8578cdb2-9cf0-4abb-9206-5909b01add1f-audit-log\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036420 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036385 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bjlg\" (UniqueName: \"kubernetes.io/projected/8578cdb2-9cf0-4abb-9206-5909b01add1f-kube-api-access-9bjlg\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036573 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036436 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-client-certs\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036573 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-client-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036573 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036543 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-tls\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036736 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-metrics-server-audit-profiles\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036736 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036601 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8578cdb2-9cf0-4abb-9206-5909b01add1f-audit-log\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.036736 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.036639 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.037193 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.037140 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8578cdb2-9cf0-4abb-9206-5909b01add1f-audit-log\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.037434 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.037409 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.037770 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.037748 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8578cdb2-9cf0-4abb-9206-5909b01add1f-metrics-server-audit-profiles\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.039641 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.039617 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-tls\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.039749 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.039723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-secret-metrics-server-client-certs\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.039866 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.039738 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8578cdb2-9cf0-4abb-9206-5909b01add1f-client-ca-bundle\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.044395 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.044363 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bjlg\" (UniqueName: \"kubernetes.io/projected/8578cdb2-9cf0-4abb-9206-5909b01add1f-kube-api-access-9bjlg\") pod \"metrics-server-557ccdc645-bnh9n\" (UID: \"8578cdb2-9cf0-4abb-9206-5909b01add1f\") " pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.152537 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.152441 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:13.296135 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.295577 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:31:13.297344 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.297319 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb"] Jun 07 16:31:13.341542 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.341511 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb"] Jun 07 16:31:13.342051 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.342023 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rpn4s" event={"ID":"b300f8f1-5edb-4654-b015-d27573f004fc","Type":"ContainerStarted","Data":"9f39aec187cd009758817f13fb9618500d90d800b8f029b214ff7fea51005166"} Jun 07 16:31:13.342170 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.341621 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.342170 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.342061 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rpn4s" event={"ID":"b300f8f1-5edb-4654-b015-d27573f004fc","Type":"ContainerStarted","Data":"d37edce2ab58804f4fa177440ae4be10b05238bda1af781baa48e11935a62091"} Jun 07 16:31:13.342170 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.341649 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rpn4s" podStartSLOduration=4.353851491 podStartE2EDuration="5.341631429s" totalImagesPullingTime="885.931571ms" totalInitContainerRuntime="101.848367ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:13.340900902 +0000 UTC m=+232.329791655" watchObservedRunningTime="2026-06-07 16:31:13.341631429 +0000 UTC m=+232.330522182" Jun 07 16:31:13.345054 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.344875 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 07 16:31:13.345159 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.345129 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-557ccdc645-bnh9n"] Jun 07 16:31:13.345312 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.345292 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sprk9\"" Jun 07 16:31:13.441834 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.441739 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jgdk\" (UniqueName: \"kubernetes.io/projected/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-kube-api-access-9jgdk\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.442148 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.442116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.543276 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.543237 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jgdk\" (UniqueName: \"kubernetes.io/projected/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-kube-api-access-9jgdk\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.543474 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.543297 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.546185 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.546158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.551180 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.551158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jgdk\" (UniqueName: \"kubernetes.io/projected/d7a9ca5b-ec35-4604-b2e2-21433ee47fd4-kube-api-access-9jgdk\") pod \"monitoring-plugin-76b68cc874-8v4rb\" (UID: \"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.655254 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.655220 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:13.825215 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.825184 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb"] Jun 07 16:31:13.828284 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:31:13.828246 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a9ca5b_ec35_4604_b2e2_21433ee47fd4.slice/crio-4df22c86312c70cf130bd8064be493f2fb7ebaace5b08506155f234989410908 WatchSource:0}: Error finding container 4df22c86312c70cf130bd8064be493f2fb7ebaace5b08506155f234989410908: Status 404 returned error can't find the container with id 4df22c86312c70cf130bd8064be493f2fb7ebaace5b08506155f234989410908 Jun 07 16:31:13.870612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.870576 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:13.870782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:13.870637 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:14.327313 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.327279 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" event={"ID":"8578cdb2-9cf0-4abb-9206-5909b01add1f","Type":"ContainerStarted","Data":"af10b73d738db122938987b854b0c9e253ef7db8d8aa0805dfeceec236ada00c"} Jun 07 16:31:14.329207 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.329158 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" event={"ID":"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4","Type":"ContainerStarted","Data":"4df22c86312c70cf130bd8064be493f2fb7ebaace5b08506155f234989410908"} Jun 07 16:31:14.714945 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.714836 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:31:14.745991 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.745965 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:31:14.746188 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.746123 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.749592 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.748971 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 07 16:31:14.749592 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.749413 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 07 16:31:14.749769 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.749619 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 07 16:31:14.749769 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.749658 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 07 16:31:14.749987 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.749970 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 07 16:31:14.750937 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.750156 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 07 16:31:14.750937 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.750661 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 07 16:31:14.750937 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.750911 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 07 16:31:14.751516 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.751098 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acp8e9bh54hmd\"" Jun 07 16:31:14.751516 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.751274 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 07 16:31:14.751516 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.751480 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 07 16:31:14.751743 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.751725 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 07 16:31:14.752192 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.752150 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p52s4\"" Jun 07 16:31:14.752417 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.752400 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 07 16:31:14.758325 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.756206 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 07 16:31:14.768944 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.768919 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 07 16:31:14.857382 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857338 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857388 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857425 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857475 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857514 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857543 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857571 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857613 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857636 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857666 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857690 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857721 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5qk\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-kube-api-access-ck5qk\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857758 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.857785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857830 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857891 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857921 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857945 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.859864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.857993 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.959384 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.959338 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.959384 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.959388 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.959384 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.959413 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.959714 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.959454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960413 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960453 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960482 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960512 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960560 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960585 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960619 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960674 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5qk\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-kube-api-access-ck5qk\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960713 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960746 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960768 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.960977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.960821 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.963025 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.962495 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.963025 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.962999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.967172 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.966316 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.967172 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.966903 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.968521 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.968499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.969186 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.969168 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.969605 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.969587 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.970000 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.969955 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.971269 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.971250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.971436 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.971265 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.971687 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.971655 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.971762 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.971741 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64900064-6a0b-44e0-ba54-b75e48d64c1d-config-out\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.972299 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.972258 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.972691 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.972673 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.973708 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.973511 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.974272 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.974224 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-web-config\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.974638 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.974614 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64900064-6a0b-44e0-ba54-b75e48d64c1d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.976124 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.976091 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.978866 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.978841 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64900064-6a0b-44e0-ba54-b75e48d64c1d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:14.979904 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:14.979884 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5qk\" (UniqueName: \"kubernetes.io/projected/64900064-6a0b-44e0-ba54-b75e48d64c1d-kube-api-access-ck5qk\") pod \"prometheus-k8s-0\" (UID: \"64900064-6a0b-44e0-ba54-b75e48d64c1d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:15.069380 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:15.069339 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:15.220755 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:15.220675 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:15.220755 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:15.220730 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:16.541752 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:16.541723 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:31:16.548098 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:31:16.548044 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64900064_6a0b_44e0_ba54_b75e48d64c1d.slice/crio-433d8c6989773f2b36c98abd8ab92a298f80a17ff2acf47621cd570bdff938b8 WatchSource:0}: Error finding container 433d8c6989773f2b36c98abd8ab92a298f80a17ff2acf47621cd570bdff938b8: Status 404 returned error can't find the container with id 433d8c6989773f2b36c98abd8ab92a298f80a17ff2acf47621cd570bdff938b8 Jun 07 16:31:17.343131 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.343092 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" event={"ID":"8578cdb2-9cf0-4abb-9206-5909b01add1f","Type":"ContainerStarted","Data":"3c4fc74c602987d4b0dc9399f44012a8398e040b04e12738b0ff32f37a59e79e"} Jun 07 16:31:17.344871 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.344836 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"433d8c6989773f2b36c98abd8ab92a298f80a17ff2acf47621cd570bdff938b8"} Jun 07 16:31:17.346850 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.346820 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" event={"ID":"d7a9ca5b-ec35-4604-b2e2-21433ee47fd4","Type":"ContainerStarted","Data":"93c77d92e70b808ae2e674ade346cb10268156c32bdd705d7f7a4d58a4e47d50"} Jun 07 16:31:17.347225 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.347203 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:17.352732 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.352712 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" Jun 07 16:31:17.360211 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.360164 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" podStartSLOduration=2.332490527 podStartE2EDuration="5.360148031s" totalImagesPullingTime="3.027657504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:17.359073153 +0000 UTC m=+236.347963907" watchObservedRunningTime="2026-06-07 16:31:17.360148031 +0000 UTC m=+236.349038821" Jun 07 16:31:17.375513 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:17.375362 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-8v4rb" podStartSLOduration=1.821785092 podStartE2EDuration="4.37534846s" totalImagesPullingTime="2.553563368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:17.373403634 +0000 UTC m=+236.362294383" watchObservedRunningTime="2026-06-07 16:31:17.37534846 +0000 UTC m=+236.364239236" Jun 07 16:31:18.202857 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:18.202832 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:18.203226 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:18.202889 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:31:18.204729 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:18.204694 2571 patch_prober.go:28] interesting pod/console-8696c8ddf8-m7ckb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 16:31:18.204915 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:18.204748 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 16:31:18.352843 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:18.352687 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"6273d2f02cb456497e183d3c9cf2e2dd565ccc4aee7640dacf7f6e67606e5091"} Jun 07 16:31:19.358436 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:19.358397 2571 generic.go:356] "Generic (PLEG): container finished" podID="64900064-6a0b-44e0-ba54-b75e48d64c1d" containerID="6273d2f02cb456497e183d3c9cf2e2dd565ccc4aee7640dacf7f6e67606e5091" exitCode=0 Jun 07 16:31:19.358888 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:19.358516 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerDied","Data":"6273d2f02cb456497e183d3c9cf2e2dd565ccc4aee7640dacf7f6e67606e5091"} Jun 07 16:31:23.379239 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:23.379166 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"eea878e1f1eccaacbe4166a3ec3e8e27ad9f3f45ecef3245913433e1ceb7c3a6"} Jun 07 16:31:23.379239 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:23.379228 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"51c238cccba2aca153b6e920c7a362a614010c032e5124010136702eb640a45c"} Jun 07 16:31:23.871546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:23.871122 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:23.871546 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:23.871191 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:25.220612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:25.220574 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:25.221090 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:25.220635 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:26.393486 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:26.393447 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"4f80a793f96c6bd36ed75f455bbe0105f91cd039ce9c23669336fe0551661f09"} Jun 07 16:31:26.393931 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:26.393530 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"7cc0f2f698ff0fe78cf7549aec3d34f46c69961b2a619e3d121a9ce1dd80f81a"} Jun 07 16:31:26.393931 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:26.393568 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"6e36c778e6f07453b9173a06f79edb87b01382baad56b04187f655899dc0e735"} Jun 07 16:31:26.393931 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:26.393626 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64900064-6a0b-44e0-ba54-b75e48d64c1d","Type":"ContainerStarted","Data":"a309f570da3e3dc4323b70f78043cf53e257271520e11d3e1622648634e4f042"} Jun 07 16:31:26.420935 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:26.420884 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.64108444 podStartE2EDuration="12.420774643s" totalImagesPullingTime="7.752910443s" totalInitContainerRuntime="26.77976ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:31:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:26.419847392 +0000 UTC m=+245.408738144" watchObservedRunningTime="2026-06-07 16:31:26.420774643 +0000 UTC m=+245.409665397" Jun 07 16:31:28.203193 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:28.203160 2571 patch_prober.go:28] interesting pod/console-8696c8ddf8-m7ckb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 16:31:28.203641 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:28.203204 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 16:31:30.069612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:30.069573 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:31:32.323038 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:32.323003 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:31:32.325412 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:32.325389 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd705cc3-6364-405b-9ab7-6e7b18b350f6-metrics-certs\") pod \"network-metrics-daemon-g7f8s\" (UID: \"dd705cc3-6364-405b-9ab7-6e7b18b350f6\") " pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:31:32.545377 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:32.545347 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:31:32.552750 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:32.552730 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7f8s" Jun 07 16:31:32.688682 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:32.688659 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7f8s"] Jun 07 16:31:32.690904 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:31:32.690874 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd705cc3_6364_405b_9ab7_6e7b18b350f6.slice/crio-26ef35d1834a27a919881f5f459bfeb05b332b0cf8da618c1095a1c475f0c5d0 WatchSource:0}: Error finding container 26ef35d1834a27a919881f5f459bfeb05b332b0cf8da618c1095a1c475f0c5d0: Status 404 returned error can't find the container with id 26ef35d1834a27a919881f5f459bfeb05b332b0cf8da618c1095a1c475f0c5d0 Jun 07 16:31:33.153146 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.153112 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:33.153308 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.153205 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:33.420598 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.420511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7f8s" event={"ID":"dd705cc3-6364-405b-9ab7-6e7b18b350f6","Type":"ContainerStarted","Data":"26ef35d1834a27a919881f5f459bfeb05b332b0cf8da618c1095a1c475f0c5d0"} Jun 07 16:31:33.870076 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.870043 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:33.870341 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.870100 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:33.870341 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.870146 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:31:33.871709 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.871151 2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"ff502b0a541b903f46262665d814b58e6d1f6261b58c96432cd2352c72764dc0"} pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" containerMessage="Container registry failed liveness probe, will be restarted" Jun 07 16:31:33.879318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.879293 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:33.879417 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:33.879332 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:34.425783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:34.425703 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7f8s" event={"ID":"dd705cc3-6364-405b-9ab7-6e7b18b350f6","Type":"ContainerStarted","Data":"6007f3da8672b64429d45e8c1a23ee221681cca21384f4453be10c33c8b5c47a"} Jun 07 16:31:34.425783 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:34.425782 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7f8s" event={"ID":"dd705cc3-6364-405b-9ab7-6e7b18b350f6","Type":"ContainerStarted","Data":"7182c54787e464e76aecc5b8580555acc134bbf9ac5e74f1c38f9073582e9deb"} Jun 07 16:31:34.441330 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:34.441275 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g7f8s" podStartSLOduration=252.125610067 podStartE2EDuration="4m13.441255701s" totalImagesPullingTime="1.315645634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:34.439778437 +0000 UTC m=+253.428669190" watchObservedRunningTime="2026-06-07 16:31:34.441255701 +0000 UTC m=+253.430146454" Jun 07 16:31:38.202700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:38.202663 2571 patch_prober.go:28] interesting pod/console-8696c8ddf8-m7ckb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 16:31:38.203238 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:38.202713 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 16:31:38.333961 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:38.333914 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-697c89d95c-nsd9k" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerName="console" containerID="cri-o://dc4a68c580c1aa8b6ebdb8128692abcd3617e76de70411547c93959bc48cd862" gracePeriod=15 Jun 07 16:31:43.874431 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:43.874399 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:43.874778 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:43.874448 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:48.203035 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:48.202992 2571 patch_prober.go:28] interesting pod/console-8696c8ddf8-m7ckb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 16:31:48.203452 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:48.203044 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 16:31:49.479281 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:49.479248 2571 generic.go:356] "Generic (PLEG): container finished" podID="99af884d-1829-4d1b-b51c-761b76432a28" containerID="86ee7b7a0b3d695c13227adbf5e959ea806fef5a321c1817383cbeeb3efa7298" exitCode=0 Jun 07 16:31:49.479727 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:49.479286 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" event={"ID":"99af884d-1829-4d1b-b51c-761b76432a28","Type":"ContainerDied","Data":"86ee7b7a0b3d695c13227adbf5e959ea806fef5a321c1817383cbeeb3efa7298"} Jun 07 16:31:49.479727 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:49.479584 2571 scope.go:117] "RemoveContainer" containerID="86ee7b7a0b3d695c13227adbf5e959ea806fef5a321c1817383cbeeb3efa7298" Jun 07 16:31:50.484977 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:50.484943 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-bwzjb" event={"ID":"99af884d-1829-4d1b-b51c-761b76432a28","Type":"ContainerStarted","Data":"3b18e0e144e73281abc74e81b18c0f60ad4b27eabbd4b9652612b89f55bbca00"} Jun 07 16:31:53.158117 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.158085 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:53.162019 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.161997 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-557ccdc645-bnh9n" Jun 07 16:31:53.488309 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.488287 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697c89d95c-nsd9k_3aff06ae-31f1-43e5-a70d-7be78a0e279f/console/0.log" Jun 07 16:31:53.496338 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.496319 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697c89d95c-nsd9k_3aff06ae-31f1-43e5-a70d-7be78a0e279f/console/0.log" Jun 07 16:31:53.496441 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.496354 2571 generic.go:356] "Generic (PLEG): container finished" podID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerID="dc4a68c580c1aa8b6ebdb8128692abcd3617e76de70411547c93959bc48cd862" exitCode=137 Jun 07 16:31:53.496441 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.496412 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697c89d95c-nsd9k" event={"ID":"3aff06ae-31f1-43e5-a70d-7be78a0e279f","Type":"ContainerDied","Data":"dc4a68c580c1aa8b6ebdb8128692abcd3617e76de70411547c93959bc48cd862"} Jun 07 16:31:53.496509 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.496458 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697c89d95c-nsd9k" event={"ID":"3aff06ae-31f1-43e5-a70d-7be78a0e279f","Type":"ContainerDied","Data":"e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c"} Jun 07 16:31:53.496509 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.496472 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e22d7ea7a042a5c1839d4e327392ff2ac169330c95a30ab5b09a4965b1f80b3c" Jun 07 16:31:53.514547 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.514522 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:31:53.597314 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597285 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597324 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597372 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597392 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597434 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp9p9\" (UniqueName: \"kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597490 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597465 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca\") pod \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\" (UID: \"3aff06ae-31f1-43e5-a70d-7be78a0e279f\") " Jun 07 16:31:53.597871 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597749 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config" (OuterVolumeSpecName: "console-config") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:31:53.597962 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597893 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:31:53.598022 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.597995 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-config\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.598022 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.598013 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-oauth-serving-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.599095 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.599069 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca" (OuterVolumeSpecName: "service-ca") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:31:53.600134 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.600110 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9" (OuterVolumeSpecName: "kube-api-access-lp9p9") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "kube-api-access-lp9p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:31:53.600232 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.600209 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:31:53.600271 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.600241 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3aff06ae-31f1-43e5-a70d-7be78a0e279f" (UID: "3aff06ae-31f1-43e5-a70d-7be78a0e279f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:31:53.699248 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.699169 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp9p9\" (UniqueName: \"kubernetes.io/projected/3aff06ae-31f1-43e5-a70d-7be78a0e279f-kube-api-access-lp9p9\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.699248 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.699198 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aff06ae-31f1-43e5-a70d-7be78a0e279f-service-ca\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.699248 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.699209 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-serving-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.699248 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.699218 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aff06ae-31f1-43e5-a70d-7be78a0e279f-console-oauth-config\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:31:53.874424 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.874394 2571 patch_prober.go:28] interesting pod/image-registry-977c8fc99-xgrrs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:31:53.874572 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:53.874446 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:31:54.502190 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.502158 2571 generic.go:356] "Generic (PLEG): container finished" podID="5c1ac630-e1d5-42bd-8308-33fac4d53a89" containerID="e8fd1922c52fd0f3b552ab4d73786679da81efc12aca4d8ed6354bcb3719bec8" exitCode=0 Jun 07 16:31:54.502612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.502237 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xlzb2" event={"ID":"5c1ac630-e1d5-42bd-8308-33fac4d53a89","Type":"ContainerDied","Data":"e8fd1922c52fd0f3b552ab4d73786679da81efc12aca4d8ed6354bcb3719bec8"} Jun 07 16:31:54.502612 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.502314 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697c89d95c-nsd9k" Jun 07 16:31:54.502758 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.502742 2571 scope.go:117] "RemoveContainer" containerID="e8fd1922c52fd0f3b552ab4d73786679da81efc12aca4d8ed6354bcb3719bec8" Jun 07 16:31:54.535838 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.535794 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:31:54.539860 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:54.539834 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-697c89d95c-nsd9k"] Jun 07 16:31:55.446060 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:55.446031 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" path="/var/lib/kubelet/pods/3aff06ae-31f1-43e5-a70d-7be78a0e279f/volumes" Jun 07 16:31:55.507187 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:55.507160 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xlzb2" event={"ID":"5c1ac630-e1d5-42bd-8308-33fac4d53a89","Type":"ContainerStarted","Data":"e142c642e47f1423ba2077124b4cda53ff66c7ff2c662b71d881241f6332618a"} Jun 07 16:31:58.203027 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:58.202994 2571 patch_prober.go:28] interesting pod/console-8696c8ddf8-m7ckb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 16:31:58.203457 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:58.203052 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 16:31:58.894385 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:58.894347 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" podUID="3332e915-18fb-4877-8355-281204c1be35" containerName="registry" containerID="cri-o://ff502b0a541b903f46262665d814b58e6d1f6261b58c96432cd2352c72764dc0" gracePeriod=30 Jun 07 16:31:59.493044 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:59.493013 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-557ccdc645-bnh9n_8578cdb2-9cf0-4abb-9206-5909b01add1f/metrics-server/0.log" Jun 07 16:31:59.693197 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:31:59.693172 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-8v4rb_d7a9ca5b-ec35-4604-b2e2-21433ee47fd4/monitoring-plugin/0.log" Jun 07 16:32:00.526507 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:00.526476 2571 generic.go:356] "Generic (PLEG): container finished" podID="3332e915-18fb-4877-8355-281204c1be35" containerID="ff502b0a541b903f46262665d814b58e6d1f6261b58c96432cd2352c72764dc0" exitCode=0 Jun 07 16:32:00.526874 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:00.526547 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" event={"ID":"3332e915-18fb-4877-8355-281204c1be35","Type":"ContainerDied","Data":"ff502b0a541b903f46262665d814b58e6d1f6261b58c96432cd2352c72764dc0"} Jun 07 16:32:00.526874 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:00.526596 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" event={"ID":"3332e915-18fb-4877-8355-281204c1be35","Type":"ContainerStarted","Data":"ecd218c1dc27a25dfae432fb7d5992206a8087efa0eb1f23004e4f1eaeb9d07f"} Jun 07 16:32:00.526874 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:00.526751 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:32:01.093395 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:01.093368 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/init-textfile/0.log" Jun 07 16:32:01.293983 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:01.293959 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/node-exporter/0.log" Jun 07 16:32:01.493425 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:01.493401 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/kube-rbac-proxy/0.log" Jun 07 16:32:02.293273 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:02.293242 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/init-config-reloader/0.log" Jun 07 16:32:02.498301 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:02.498268 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/prometheus/0.log" Jun 07 16:32:02.706296 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:02.706266 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/config-reloader/0.log" Jun 07 16:32:02.893864 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:02.893836 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/thanos-sidecar/0.log" Jun 07 16:32:03.041930 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:32:03.041840 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b5hhm" podUID="1d9f052d-7795-4e0a-8612-3dc9c772605a" Jun 07 16:32:03.093701 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:03.093678 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy-web/0.log" Jun 07 16:32:03.293725 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:03.293643 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy/0.log" Jun 07 16:32:03.492940 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:03.492912 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy-thanos/0.log" Jun 07 16:32:03.536349 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:03.536325 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:03.709536 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:03.709505 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:32:05.493454 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:05.493423 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-pp552_07011e4e-352f-4148-a8ad-2bdedb5de004/networking-console-plugin/0.log" Jun 07 16:32:06.294425 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.294400 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8696c8ddf8-m7ckb_662429b0-a5a4-4d9e-b064-d5e1b9adcc23/console/0.log" Jun 07 16:32:06.307389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.307360 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:06.309779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.309756 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9f052d-7795-4e0a-8612-3dc9c772605a-metrics-tls\") pod \"dns-default-b5hhm\" (UID: \"1d9f052d-7795-4e0a-8612-3dc9c772605a\") " pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:06.493779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.493747 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hhsdr_a045a83d-fa63-4631-8bb1-6c1fa4d4b342/download-server/0.log" Jun 07 16:32:06.539557 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.539533 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:32:06.547448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.547389 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:06.672906 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:06.672829 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5hhm"] Jun 07 16:32:06.674965 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:32:06.674939 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9f052d_7795_4e0a_8612_3dc9c772605a.slice/crio-51b748313141f789f1bf1f4036ccf8e15c88f77785766796f0357e62d404ada6 WatchSource:0}: Error finding container 51b748313141f789f1bf1f4036ccf8e15c88f77785766796f0357e62d404ada6: Status 404 returned error can't find the container with id 51b748313141f789f1bf1f4036ccf8e15c88f77785766796f0357e62d404ada6 Jun 07 16:32:07.552587 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:07.552547 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5hhm" event={"ID":"1d9f052d-7795-4e0a-8612-3dc9c772605a","Type":"ContainerStarted","Data":"51b748313141f789f1bf1f4036ccf8e15c88f77785766796f0357e62d404ada6"} Jun 07 16:32:08.093201 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.093162 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpc55_f2945f93-8b68-4f02-ba8b-eb5c0a68e375/dns-node-resolver/0.log" Jun 07 16:32:08.558164 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.558130 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5hhm" event={"ID":"1d9f052d-7795-4e0a-8612-3dc9c772605a","Type":"ContainerStarted","Data":"06d67eb4b9b4ab9fc2ea834bcc151d20d1c260006b349d9ec647f2a986401bcb"} Jun 07 16:32:08.558548 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.558182 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5hhm" event={"ID":"1d9f052d-7795-4e0a-8612-3dc9c772605a","Type":"ContainerStarted","Data":"8ed82d1ee7bf9cd28b951f0b736922ace27b84022f5455ba20de05e1f81bf4b3"} Jun 07 16:32:08.558548 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.558245 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:08.574889 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.574847 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b5hhm" podStartSLOduration=250.979621828 podStartE2EDuration="4m12.574830235s" totalImagesPullingTime="1.595208407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:32:08.573711062 +0000 UTC m=+287.562601814" watchObservedRunningTime="2026-06-07 16:32:08.574830235 +0000 UTC m=+287.563720988" Jun 07 16:32:08.693962 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.693888 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-977c8fc99-xgrrs_3332e915-18fb-4877-8355-281204c1be35/registry/1.log" Jun 07 16:32:08.893725 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:08.893693 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p4v7_943eb10a-03c7-4fc3-a29f-1771d65b346e/node-ca/0.log" Jun 07 16:32:09.494276 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:09.494251 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f75767cf5-gqgpp_2a5337ba-2832-4e97-8730-5fac0b5cae54/router/0.log" Jun 07 16:32:10.093761 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:10.093735 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztb8b_8a251d10-e94f-4056-88a1-cc0c794b0278/serve-healthcheck-canary/0.log" Jun 07 16:32:15.069960 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:15.069925 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:32:15.086341 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:15.086317 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:32:15.604047 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:15.604021 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:32:18.564056 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:18.564028 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b5hhm" Jun 07 16:32:21.381900 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.381861 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697c89d95c-nsd9k_3aff06ae-31f1-43e5-a70d-7be78a0e279f/console/0.log" Jun 07 16:32:21.384937 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.384914 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697c89d95c-nsd9k_3aff06ae-31f1-43e5-a70d-7be78a0e279f/console/0.log" Jun 07 16:32:21.389668 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.389649 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:32:21.392962 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.392941 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:32:21.397368 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.397351 2571 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:32:21.534078 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:21.534053 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-977c8fc99-xgrrs" Jun 07 16:32:28.729570 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:28.729530 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8696c8ddf8-m7ckb" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" containerID="cri-o://f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f" gracePeriod=15 Jun 07 16:32:28.973537 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:28.973514 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:32:29.094674 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094591 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094674 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094646 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094676 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6gln\" (UniqueName: \"kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094708 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094732 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094760 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.094923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.094862 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config\") pod \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\" (UID: \"662429b0-a5a4-4d9e-b064-d5e1b9adcc23\") " Jun 07 16:32:29.095167 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.095058 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca" (OuterVolumeSpecName: "service-ca") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:29.095318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.095291 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:29.095318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.095304 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:29.095663 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.095410 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config" (OuterVolumeSpecName: "console-config") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:29.097098 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.097072 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:32:29.097200 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.097096 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:32:29.097200 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.097097 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln" (OuterVolumeSpecName: "kube-api-access-f6gln") pod "662429b0-a5a4-4d9e-b064-d5e1b9adcc23" (UID: "662429b0-a5a4-4d9e-b064-d5e1b9adcc23"). InnerVolumeSpecName "kube-api-access-f6gln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:32:29.196350 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196318 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-serving-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196350 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196347 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-oauth-config\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196350 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196357 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-oauth-serving-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196582 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196366 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-console-config\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196582 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196380 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-service-ca\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196582 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196392 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-trusted-ca-bundle\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.196582 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.196400 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6gln\" (UniqueName: \"kubernetes.io/projected/662429b0-a5a4-4d9e-b064-d5e1b9adcc23-kube-api-access-f6gln\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:32:29.641489 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.641453 2571 generic.go:356] "Generic (PLEG): container finished" podID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerID="f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f" exitCode=0 Jun 07 16:32:29.641687 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.641496 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8696c8ddf8-m7ckb" event={"ID":"662429b0-a5a4-4d9e-b064-d5e1b9adcc23","Type":"ContainerDied","Data":"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f"} Jun 07 16:32:29.641687 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.641500 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8696c8ddf8-m7ckb" Jun 07 16:32:29.641687 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.641543 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8696c8ddf8-m7ckb" event={"ID":"662429b0-a5a4-4d9e-b064-d5e1b9adcc23","Type":"ContainerDied","Data":"05525cbea0abbf80ca6562cb861db896e878471c85360693333589912422687f"} Jun 07 16:32:29.641687 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.641568 2571 scope.go:117] "RemoveContainer" containerID="f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f" Jun 07 16:32:29.650223 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.650208 2571 scope.go:117] "RemoveContainer" containerID="f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f" Jun 07 16:32:29.650451 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:32:29.650433 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f\": container with ID starting with f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f not found: ID does not exist" containerID="f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f" Jun 07 16:32:29.650515 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.650459 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f"} err="failed to get container status \"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f\": rpc error: code = NotFound desc = could not find container \"f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f\": container with ID starting with f681702fbb2a2ab8d094739647aa339d7c7352d5cde7308447f9a6bf2046f47f not found: ID does not exist" Jun 07 16:32:29.656829 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.656789 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:32:29.659489 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:29.659469 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8696c8ddf8-m7ckb"] Jun 07 16:32:31.445576 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:32:31.445539 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" path="/var/lib/kubelet/pods/662429b0-a5a4-4d9e-b064-d5e1b9adcc23/volumes" Jun 07 16:34:49.495127 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495045 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4"] Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495511 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495532 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495553 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerName="console" Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495562 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerName="console" Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495635 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aff06ae-31f1-43e5-a70d-7be78a0e279f" containerName="console" Jun 07 16:34:49.495700 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.495648 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="662429b0-a5a4-4d9e-b064-d5e1b9adcc23" containerName="console" Jun 07 16:34:49.498705 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.498682 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.502159 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.501964 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:34:49.502950 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.502929 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ff967\"" Jun 07 16:34:49.503238 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.503224 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:34:49.503312 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.503226 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:34:49.505851 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.505830 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:34:49.530554 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.530535 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4"] Jun 07 16:34:49.637926 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.637893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.638064 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.637938 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.638064 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.637989 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnm7g\" (UniqueName: \"kubernetes.io/projected/05b0554d-a8d9-4199-9eb0-ed28381363d1-kube-api-access-xnm7g\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.638064 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.638042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.638216 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.638101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.738561 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738525 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.738741 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.738741 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738603 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.738741 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738718 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnm7g\" (UniqueName: \"kubernetes.io/projected/05b0554d-a8d9-4199-9eb0-ed28381363d1-kube-api-access-xnm7g\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.738946 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738769 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.739010 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.738981 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.741021 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.740998 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b0554d-a8d9-4199-9eb0-ed28381363d1-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.741223 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.741207 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.741362 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.741343 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05b0554d-a8d9-4199-9eb0-ed28381363d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.760949 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.760884 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnm7g\" (UniqueName: \"kubernetes.io/projected/05b0554d-a8d9-4199-9eb0-ed28381363d1-kube-api-access-xnm7g\") pod \"opendatahub-operator-controller-manager-768db79f96-sjhx4\" (UID: \"05b0554d-a8d9-4199-9eb0-ed28381363d1\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:49.809233 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:49.809204 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:50.011981 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:50.011956 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4"] Jun 07 16:34:50.014495 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:34:50.014472 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b0554d_a8d9_4199_9eb0_ed28381363d1.slice/crio-f176a20d23e9192480d8519b44724b59e56f48a614a4a90ca45bf6acdaa2462d WatchSource:0}: Error finding container f176a20d23e9192480d8519b44724b59e56f48a614a4a90ca45bf6acdaa2462d: Status 404 returned error can't find the container with id f176a20d23e9192480d8519b44724b59e56f48a614a4a90ca45bf6acdaa2462d Jun 07 16:34:50.016320 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:50.016303 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:34:50.174032 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:50.174000 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" event={"ID":"05b0554d-a8d9-4199-9eb0-ed28381363d1","Type":"ContainerStarted","Data":"f176a20d23e9192480d8519b44724b59e56f48a614a4a90ca45bf6acdaa2462d"} Jun 07 16:34:53.192116 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:53.192009 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" event={"ID":"05b0554d-a8d9-4199-9eb0-ed28381363d1","Type":"ContainerStarted","Data":"31704f6cddfd4075b58a0a9db8475a146439c2f52c9058b0aacf2c5c427edec1"} Jun 07 16:34:54.198164 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:54.198060 2571 generic.go:356] "Generic (PLEG): container finished" podID="05b0554d-a8d9-4199-9eb0-ed28381363d1" containerID="31704f6cddfd4075b58a0a9db8475a146439c2f52c9058b0aacf2c5c427edec1" exitCode=0 Jun 07 16:34:54.198164 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:54.198150 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" event={"ID":"05b0554d-a8d9-4199-9eb0-ed28381363d1","Type":"ContainerDied","Data":"31704f6cddfd4075b58a0a9db8475a146439c2f52c9058b0aacf2c5c427edec1"} Jun 07 16:34:55.204404 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:55.204370 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" event={"ID":"05b0554d-a8d9-4199-9eb0-ed28381363d1","Type":"ContainerStarted","Data":"2f31ce61ac4d3012eed8fc0417a0520eef100a1219c47c84455c3d3cd4a3c703"} Jun 07 16:34:55.204787 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:55.204464 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:34:55.226902 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:34:55.226861 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" podStartSLOduration=2.212619569 podStartE2EDuration="6.22684809s" totalImagesPullingTime="3.021047673s" totalInitContainerRuntime="993.180848ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:55.225241595 +0000 UTC m=+454.214132343" watchObservedRunningTime="2026-06-07 16:34:55.22684809 +0000 UTC m=+454.215738842" Jun 07 16:35:06.211128 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:06.211096 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-sjhx4" Jun 07 16:35:09.785010 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.784968 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x"] Jun 07 16:35:09.793178 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.793146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.799974 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.799679 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p9bwv\"" Jun 07 16:35:09.800166 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.800148 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 16:35:09.800255 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.800211 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:35:09.800312 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.800263 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 16:35:09.800367 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.800308 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 16:35:09.803923 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.803907 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 16:35:09.809936 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.809708 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x"] Jun 07 16:35:09.894596 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.894568 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.894757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.894627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68e0b19e-1ab0-4c05-a377-21aa81405a0b-manager-config\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.894757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.894652 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrvr\" (UniqueName: \"kubernetes.io/projected/68e0b19e-1ab0-4c05-a377-21aa81405a0b-kube-api-access-mvrvr\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.894757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.894744 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.995611 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.995570 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.995611 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.995625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68e0b19e-1ab0-4c05-a377-21aa81405a0b-manager-config\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.995875 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.995647 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrvr\" (UniqueName: \"kubernetes.io/projected/68e0b19e-1ab0-4c05-a377-21aa81405a0b-kube-api-access-mvrvr\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.995875 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.995686 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.996370 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.996353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/68e0b19e-1ab0-4c05-a377-21aa81405a0b-manager-config\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.998146 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.998127 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:09.998214 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:09.998191 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/68e0b19e-1ab0-4c05-a377-21aa81405a0b-metrics-cert\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:10.006594 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:10.006569 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrvr\" (UniqueName: \"kubernetes.io/projected/68e0b19e-1ab0-4c05-a377-21aa81405a0b-kube-api-access-mvrvr\") pod \"lws-controller-manager-b9d9f97f8-fgw9x\" (UID: \"68e0b19e-1ab0-4c05-a377-21aa81405a0b\") " pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:10.103012 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:10.102947 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:10.277663 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:10.277631 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x"] Jun 07 16:35:10.283410 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:35:10.283385 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e0b19e_1ab0_4c05_a377_21aa81405a0b.slice/crio-47157abd047dcab0a1ccc5dae2863b615bfd16c90338afb34d6b9deda4d1a057 WatchSource:0}: Error finding container 47157abd047dcab0a1ccc5dae2863b615bfd16c90338afb34d6b9deda4d1a057: Status 404 returned error can't find the container with id 47157abd047dcab0a1ccc5dae2863b615bfd16c90338afb34d6b9deda4d1a057 Jun 07 16:35:11.274464 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:11.274427 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" event={"ID":"68e0b19e-1ab0-4c05-a377-21aa81405a0b","Type":"ContainerStarted","Data":"47157abd047dcab0a1ccc5dae2863b615bfd16c90338afb34d6b9deda4d1a057"} Jun 07 16:35:14.290852 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.290796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" event={"ID":"68e0b19e-1ab0-4c05-a377-21aa81405a0b","Type":"ContainerStarted","Data":"7321a71ee92fb7c0ebefd8a5fa2afa7de399f27759ed674815365dc5939a35e3"} Jun 07 16:35:14.291285 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.290920 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:35:14.310292 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.310247 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" podStartSLOduration=1.9912159900000002 podStartE2EDuration="5.31023489s" totalImagesPullingTime="3.3190189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:14.308560547 +0000 UTC m=+473.297451298" watchObservedRunningTime="2026-06-07 16:35:14.31023489 +0000 UTC m=+473.299125642" Jun 07 16:35:14.947303 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.947272 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-ts5kl"] Jun 07 16:35:14.950573 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.950556 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:14.953341 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.953313 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 16:35:14.953479 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.953399 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 16:35:14.953479 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.953443 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fpbjp\"" Jun 07 16:35:14.960257 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:14.960236 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-ts5kl"] Jun 07 16:35:15.040042 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.040014 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmd7\" (UniqueName: \"kubernetes.io/projected/2b4089a9-5e2c-40ab-9305-15ad5eb91054-kube-api-access-jqmd7\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.040180 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.040126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tmp\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.040228 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.040195 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tls-certs\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.141281 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.141255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tmp\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.141416 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.141303 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tls-certs\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.141416 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.141343 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmd7\" (UniqueName: \"kubernetes.io/projected/2b4089a9-5e2c-40ab-9305-15ad5eb91054-kube-api-access-jqmd7\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.143706 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.143664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tmp\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.143821 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.143756 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b4089a9-5e2c-40ab-9305-15ad5eb91054-tls-certs\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.149470 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.149446 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmd7\" (UniqueName: \"kubernetes.io/projected/2b4089a9-5e2c-40ab-9305-15ad5eb91054-kube-api-access-jqmd7\") pod \"kube-auth-proxy-786f88c98-ts5kl\" (UID: \"2b4089a9-5e2c-40ab-9305-15ad5eb91054\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.262448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.262426 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" Jun 07 16:35:15.391579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:15.391553 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-ts5kl"] Jun 07 16:35:15.393889 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:35:15.393860 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4089a9_5e2c_40ab_9305_15ad5eb91054.slice/crio-878a05c790ae951929e1174e99cd938a3e3a4dd22e1ff41fd9b322602febe91d WatchSource:0}: Error finding container 878a05c790ae951929e1174e99cd938a3e3a4dd22e1ff41fd9b322602febe91d: Status 404 returned error can't find the container with id 878a05c790ae951929e1174e99cd938a3e3a4dd22e1ff41fd9b322602febe91d Jun 07 16:35:16.303163 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:16.303118 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" event={"ID":"2b4089a9-5e2c-40ab-9305-15ad5eb91054","Type":"ContainerStarted","Data":"878a05c790ae951929e1174e99cd938a3e3a4dd22e1ff41fd9b322602febe91d"} Jun 07 16:35:18.314880 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:18.314842 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" event={"ID":"2b4089a9-5e2c-40ab-9305-15ad5eb91054","Type":"ContainerStarted","Data":"beeeabfd74582509d81eca57007e6f135b99195f00f1779304b52df0022a744a"} Jun 07 16:35:18.351849 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:18.351727 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-786f88c98-ts5kl" podStartSLOduration=1.649500701 podStartE2EDuration="4.351709791s" totalImagesPullingTime="2.70220909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:18.35036167 +0000 UTC m=+477.339252423" watchObservedRunningTime="2026-06-07 16:35:18.351709791 +0000 UTC m=+477.340600544" Jun 07 16:35:25.297640 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:35:25.297611 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b9d9f97f8-fgw9x" Jun 07 16:36:56.203867 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.203833 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc"] Jun 07 16:36:56.207050 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.207034 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.211117 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.211094 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qg4pn\"" Jun 07 16:36:56.211346 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.211328 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:36:56.211420 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.211335 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 07 16:36:56.211420 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.211370 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 07 16:36:56.211530 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.211468 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:36:56.216796 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.216773 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc"] Jun 07 16:36:56.372366 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.372334 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e4a6178-5760-43f8-a963-ae23ca87324c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.372499 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.372372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhwqc\" (UniqueName: \"kubernetes.io/projected/5e4a6178-5760-43f8-a963-ae23ca87324c-kube-api-access-hhwqc\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.372499 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.372402 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.473156 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.473065 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e4a6178-5760-43f8-a963-ae23ca87324c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.473156 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.473106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhwqc\" (UniqueName: \"kubernetes.io/projected/5e4a6178-5760-43f8-a963-ae23ca87324c-kube-api-access-hhwqc\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.473156 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.473140 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.473409 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:36:56.473304 2571 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 07 16:36:56.473463 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:36:56.473421 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert podName:5e4a6178-5760-43f8-a963-ae23ca87324c nodeName:}" failed. No retries permitted until 2026-06-07 16:36:56.973401142 +0000 UTC m=+575.962291889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-jh4kc" (UID: "5e4a6178-5760-43f8-a963-ae23ca87324c") : secret "plugin-serving-cert" not found Jun 07 16:36:56.473749 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.473728 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e4a6178-5760-43f8-a963-ae23ca87324c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.482286 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.482256 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhwqc\" (UniqueName: \"kubernetes.io/projected/5e4a6178-5760-43f8-a963-ae23ca87324c-kube-api-access-hhwqc\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.977459 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.977417 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:56.979963 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:56.979942 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4a6178-5760-43f8-a963-ae23ca87324c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jh4kc\" (UID: \"5e4a6178-5760-43f8-a963-ae23ca87324c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:57.126580 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:57.126553 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" Jun 07 16:36:57.253062 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:57.253039 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc"] Jun 07 16:36:57.255301 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:36:57.255269 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e4a6178_5760_43f8_a963_ae23ca87324c.slice/crio-670eeecb5b47582fe2dd5314ea5bf175539b2527d2de3485fd7b14a85ce506a2 WatchSource:0}: Error finding container 670eeecb5b47582fe2dd5314ea5bf175539b2527d2de3485fd7b14a85ce506a2: Status 404 returned error can't find the container with id 670eeecb5b47582fe2dd5314ea5bf175539b2527d2de3485fd7b14a85ce506a2 Jun 07 16:36:57.732757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:36:57.732724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" event={"ID":"5e4a6178-5760-43f8-a963-ae23ca87324c","Type":"ContainerStarted","Data":"670eeecb5b47582fe2dd5314ea5bf175539b2527d2de3485fd7b14a85ce506a2"} Jun 07 16:37:06.233416 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.233382 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb"] Jun 07 16:37:06.237214 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.237188 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:06.239556 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.239535 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rm558\"" Jun 07 16:37:06.248230 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.248206 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb"] Jun 07 16:37:06.264732 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.264703 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmpgl\" (UniqueName: \"kubernetes.io/projected/45ed6f13-e3cc-48e6-824c-6be960baa58f-kube-api-access-kmpgl\") pod \"limitador-operator-controller-manager-859d7b78bd-gdkcb\" (UID: \"45ed6f13-e3cc-48e6-824c-6be960baa58f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:06.365442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.365404 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmpgl\" (UniqueName: \"kubernetes.io/projected/45ed6f13-e3cc-48e6-824c-6be960baa58f-kube-api-access-kmpgl\") pod \"limitador-operator-controller-manager-859d7b78bd-gdkcb\" (UID: \"45ed6f13-e3cc-48e6-824c-6be960baa58f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:06.373658 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.373633 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmpgl\" (UniqueName: \"kubernetes.io/projected/45ed6f13-e3cc-48e6-824c-6be960baa58f-kube-api-access-kmpgl\") pod \"limitador-operator-controller-manager-859d7b78bd-gdkcb\" (UID: \"45ed6f13-e3cc-48e6-824c-6be960baa58f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:06.549908 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:06.549827 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:20.163444 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:20.163414 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb"] Jun 07 16:37:20.165543 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:37:20.165518 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ed6f13_e3cc_48e6_824c_6be960baa58f.slice/crio-f522a5d840c304ed201a92d4a89800c9f8186059fc42ca65d9d499ce49a61943 WatchSource:0}: Error finding container f522a5d840c304ed201a92d4a89800c9f8186059fc42ca65d9d499ce49a61943: Status 404 returned error can't find the container with id f522a5d840c304ed201a92d4a89800c9f8186059fc42ca65d9d499ce49a61943 Jun 07 16:37:20.851989 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:20.851946 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" event={"ID":"5e4a6178-5760-43f8-a963-ae23ca87324c","Type":"ContainerStarted","Data":"4b0ec51cdd3903bd7ed663899b7239c368632ad33a2d5a1db9509439f8cb5c12"} Jun 07 16:37:20.853148 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:20.853121 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" event={"ID":"45ed6f13-e3cc-48e6-824c-6be960baa58f","Type":"ContainerStarted","Data":"f522a5d840c304ed201a92d4a89800c9f8186059fc42ca65d9d499ce49a61943"} Jun 07 16:37:20.871721 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:20.871676 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jh4kc" podStartSLOduration=2.015668274 podStartE2EDuration="24.87166099s" totalImagesPullingTime="22.855992716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:20.869744975 +0000 UTC m=+599.858635728" watchObservedRunningTime="2026-06-07 16:37:20.87166099 +0000 UTC m=+599.860551741" Jun 07 16:37:21.422780 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.422747 2571 scope.go:117] "RemoveContainer" containerID="dc4a68c580c1aa8b6ebdb8128692abcd3617e76de70411547c93959bc48cd862" Jun 07 16:37:21.673621 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.673558 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:37:21.674108 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.674086 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:37:21.858871 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.858842 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" event={"ID":"45ed6f13-e3cc-48e6-824c-6be960baa58f","Type":"ContainerStarted","Data":"b65fdef0ce2b32662d1ee3d579ee014060157a3f8f0301957f69284164f7ed26"} Jun 07 16:37:21.859098 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.859083 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:21.874441 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:21.874397 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" podStartSLOduration=14.340109808 podStartE2EDuration="15.87438563s" totalImagesPullingTime="1.534275822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:21.873511097 +0000 UTC m=+600.862401861" watchObservedRunningTime="2026-06-07 16:37:21.87438563 +0000 UTC m=+600.863276382" Jun 07 16:37:32.865303 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:32.865224 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gdkcb" Jun 07 16:37:40.174139 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.174108 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:37:40.216494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.216469 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:37:40.216640 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.216562 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:37:40.219290 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.219269 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7bl5\"" Jun 07 16:37:40.370874 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.370836 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnd4v\" (UniqueName: \"kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v\") pod \"authorino-75d556bd77-cgksc\" (UID: \"4920c60b-bc03-4bcd-be21-b7ff52595c99\") " pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:37:40.471767 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.471741 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnd4v\" (UniqueName: \"kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v\") pod \"authorino-75d556bd77-cgksc\" (UID: \"4920c60b-bc03-4bcd-be21-b7ff52595c99\") " pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:37:40.480082 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.480056 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnd4v\" (UniqueName: \"kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v\") pod \"authorino-75d556bd77-cgksc\" (UID: \"4920c60b-bc03-4bcd-be21-b7ff52595c99\") " pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:37:40.525369 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.525345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:37:40.682156 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.682129 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:37:40.684797 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:37:40.684766 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4920c60b_bc03_4bcd_be21_b7ff52595c99.slice/crio-11d30f3f3ab99d0c78d920560ef52ce5b8a129fd127fc5a3d9f5cc22f58cfeaa WatchSource:0}: Error finding container 11d30f3f3ab99d0c78d920560ef52ce5b8a129fd127fc5a3d9f5cc22f58cfeaa: Status 404 returned error can't find the container with id 11d30f3f3ab99d0c78d920560ef52ce5b8a129fd127fc5a3d9f5cc22f58cfeaa Jun 07 16:37:40.938857 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:40.938763 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgksc" event={"ID":"4920c60b-bc03-4bcd-be21-b7ff52595c99","Type":"ContainerStarted","Data":"11d30f3f3ab99d0c78d920560ef52ce5b8a129fd127fc5a3d9f5cc22f58cfeaa"} Jun 07 16:37:44.960282 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:44.960242 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgksc" event={"ID":"4920c60b-bc03-4bcd-be21-b7ff52595c99","Type":"ContainerStarted","Data":"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e"} Jun 07 16:37:44.981499 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:37:44.981452 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cgksc" podStartSLOduration=1.373885557 podStartE2EDuration="4.981437167s" totalImagesPullingTime="3.60755161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:44.979317423 +0000 UTC m=+623.968208174" watchObservedRunningTime="2026-06-07 16:37:44.981437167 +0000 UTC m=+623.970327918" Jun 07 16:39:04.596322 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.596239 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:04.598839 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.598796 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:04.608720 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.608693 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:04.677616 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.677585 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24868\" (UniqueName: \"kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868\") pod \"authorino-5d4b67c446-4fcbs\" (UID: \"aba6cd2f-7c70-47a3-a910-f257a7c09866\") " pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:04.778895 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.778863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24868\" (UniqueName: \"kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868\") pod \"authorino-5d4b67c446-4fcbs\" (UID: \"aba6cd2f-7c70-47a3-a910-f257a7c09866\") " pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:04.787245 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.787214 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24868\" (UniqueName: \"kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868\") pod \"authorino-5d4b67c446-4fcbs\" (UID: \"aba6cd2f-7c70-47a3-a910-f257a7c09866\") " pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:04.820071 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.820037 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:04.820331 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.820318 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:04.845253 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.845205 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-845ff7689f-wtf8g"] Jun 07 16:39:04.847867 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.847790 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:04.853932 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.853909 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845ff7689f-wtf8g"] Jun 07 16:39:04.903779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.903747 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845ff7689f-wtf8g"] Jun 07 16:39:04.904833 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:39:04.904657 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d6x5f], unattached volumes=[], failed to process volumes=[kube-api-access-d6x5f]: context canceled" pod="kuadrant-system/authorino-845ff7689f-wtf8g" podUID="626a45f3-dd5e-4ef4-96c0-cdaa3f30f928" Jun 07 16:39:04.927221 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.927189 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:39:04.930037 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.930017 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:04.932556 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.932533 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 07 16:39:04.940010 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.939677 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:39:04.972207 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.972182 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:04.973898 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:39:04.973873 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaba6cd2f_7c70_47a3_a910_f257a7c09866.slice/crio-af97fc4b25f82cc14aadf42af7923b5896251750097ab958da4c96158a6c5c42 WatchSource:0}: Error finding container af97fc4b25f82cc14aadf42af7923b5896251750097ab958da4c96158a6c5c42: Status 404 returned error can't find the container with id af97fc4b25f82cc14aadf42af7923b5896251750097ab958da4c96158a6c5c42 Jun 07 16:39:04.981096 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.981070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6x5f\" (UniqueName: \"kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f\") pod \"authorino-845ff7689f-wtf8g\" (UID: \"626a45f3-dd5e-4ef4-96c0-cdaa3f30f928\") " pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:04.981198 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.981129 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:04.981255 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:04.981198 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zldfl\" (UniqueName: \"kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.082079 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.082046 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6x5f\" (UniqueName: \"kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f\") pod \"authorino-845ff7689f-wtf8g\" (UID: \"626a45f3-dd5e-4ef4-96c0-cdaa3f30f928\") " pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:05.082251 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.082090 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.082251 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.082131 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zldfl\" (UniqueName: \"kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.084635 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.084609 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.090075 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.090053 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6x5f\" (UniqueName: \"kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f\") pod \"authorino-845ff7689f-wtf8g\" (UID: \"626a45f3-dd5e-4ef4-96c0-cdaa3f30f928\") " pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:05.090429 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.090410 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zldfl\" (UniqueName: \"kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl\") pod \"authorino-57c4f68767-7ss68\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.243544 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.243514 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:39:05.312402 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.312382 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:05.312503 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.312375 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" event={"ID":"aba6cd2f-7c70-47a3-a910-f257a7c09866","Type":"ContainerStarted","Data":"af97fc4b25f82cc14aadf42af7923b5896251750097ab958da4c96158a6c5c42"} Jun 07 16:39:05.323665 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.323642 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:05.381123 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.381101 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:39:05.382927 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:39:05.382899 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77a63322_943b_48d1_abcc_61265d7ed48b.slice/crio-f6bf95ed0ddf9d018d426371a4c7976eed0543b72f768d33a78c7a2f9620c91e WatchSource:0}: Error finding container f6bf95ed0ddf9d018d426371a4c7976eed0543b72f768d33a78c7a2f9620c91e: Status 404 returned error can't find the container with id f6bf95ed0ddf9d018d426371a4c7976eed0543b72f768d33a78c7a2f9620c91e Jun 07 16:39:05.383973 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.383952 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6x5f\" (UniqueName: \"kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f\") pod \"626a45f3-dd5e-4ef4-96c0-cdaa3f30f928\" (UID: \"626a45f3-dd5e-4ef4-96c0-cdaa3f30f928\") " Jun 07 16:39:05.386189 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.386165 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f" (OuterVolumeSpecName: "kube-api-access-d6x5f") pod "626a45f3-dd5e-4ef4-96c0-cdaa3f30f928" (UID: "626a45f3-dd5e-4ef4-96c0-cdaa3f30f928"). InnerVolumeSpecName "kube-api-access-d6x5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:39:05.485430 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:05.485398 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6x5f\" (UniqueName: \"kubernetes.io/projected/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928-kube-api-access-d6x5f\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:39:06.317893 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.317854 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c4f68767-7ss68" event={"ID":"77a63322-943b-48d1-abcc-61265d7ed48b","Type":"ContainerStarted","Data":"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6"} Jun 07 16:39:06.318305 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.317904 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c4f68767-7ss68" event={"ID":"77a63322-943b-48d1-abcc-61265d7ed48b","Type":"ContainerStarted","Data":"f6bf95ed0ddf9d018d426371a4c7976eed0543b72f768d33a78c7a2f9620c91e"} Jun 07 16:39:06.319318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.319290 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" event={"ID":"aba6cd2f-7c70-47a3-a910-f257a7c09866","Type":"ContainerStarted","Data":"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262"} Jun 07 16:39:06.319318 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.319312 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845ff7689f-wtf8g" Jun 07 16:39:06.319471 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.319326 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" podUID="aba6cd2f-7c70-47a3-a910-f257a7c09866" containerName="authorino" containerID="cri-o://bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262" gracePeriod=30 Jun 07 16:39:06.334211 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.334168 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57c4f68767-7ss68" podStartSLOduration=2.044618828 podStartE2EDuration="2.334154613s" totalImagesPullingTime="289.535785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:06.332879139 +0000 UTC m=+705.321769910" watchObservedRunningTime="2026-06-07 16:39:06.334154613 +0000 UTC m=+705.323045366" Jun 07 16:39:06.354945 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.354923 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-845ff7689f-wtf8g"] Jun 07 16:39:06.359991 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.359961 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-845ff7689f-wtf8g"] Jun 07 16:39:06.362910 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.362880 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:39:06.363081 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.363058 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cgksc" podUID="4920c60b-bc03-4bcd-be21-b7ff52595c99" containerName="authorino" containerID="cri-o://befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e" gracePeriod=30 Jun 07 16:39:06.372867 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.372788 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" podStartSLOduration=2.04575969 podStartE2EDuration="2.372767024s" totalImagesPullingTime="327.007334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:06.371792905 +0000 UTC m=+705.360683658" watchObservedRunningTime="2026-06-07 16:39:06.372767024 +0000 UTC m=+705.361657777" Jun 07 16:39:06.613913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.613890 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:06.630301 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.630278 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:39:06.695584 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.695559 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnd4v\" (UniqueName: \"kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v\") pod \"4920c60b-bc03-4bcd-be21-b7ff52595c99\" (UID: \"4920c60b-bc03-4bcd-be21-b7ff52595c99\") " Jun 07 16:39:06.695725 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.695614 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24868\" (UniqueName: \"kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868\") pod \"aba6cd2f-7c70-47a3-a910-f257a7c09866\" (UID: \"aba6cd2f-7c70-47a3-a910-f257a7c09866\") " Jun 07 16:39:06.697913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.697888 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868" (OuterVolumeSpecName: "kube-api-access-24868") pod "aba6cd2f-7c70-47a3-a910-f257a7c09866" (UID: "aba6cd2f-7c70-47a3-a910-f257a7c09866"). InnerVolumeSpecName "kube-api-access-24868". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:39:06.698017 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.697909 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v" (OuterVolumeSpecName: "kube-api-access-fnd4v") pod "4920c60b-bc03-4bcd-be21-b7ff52595c99" (UID: "4920c60b-bc03-4bcd-be21-b7ff52595c99"). InnerVolumeSpecName "kube-api-access-fnd4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:39:06.797164 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.797142 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnd4v\" (UniqueName: \"kubernetes.io/projected/4920c60b-bc03-4bcd-be21-b7ff52595c99-kube-api-access-fnd4v\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:39:06.797164 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:06.797164 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24868\" (UniqueName: \"kubernetes.io/projected/aba6cd2f-7c70-47a3-a910-f257a7c09866-kube-api-access-24868\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:39:07.325110 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.325072 2571 generic.go:356] "Generic (PLEG): container finished" podID="4920c60b-bc03-4bcd-be21-b7ff52595c99" containerID="befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e" exitCode=0 Jun 07 16:39:07.325540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.325122 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgksc" Jun 07 16:39:07.325540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.325158 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgksc" event={"ID":"4920c60b-bc03-4bcd-be21-b7ff52595c99","Type":"ContainerDied","Data":"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e"} Jun 07 16:39:07.325540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.325204 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgksc" event={"ID":"4920c60b-bc03-4bcd-be21-b7ff52595c99","Type":"ContainerDied","Data":"11d30f3f3ab99d0c78d920560ef52ce5b8a129fd127fc5a3d9f5cc22f58cfeaa"} Jun 07 16:39:07.325540 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.325229 2571 scope.go:117] "RemoveContainer" containerID="befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e" Jun 07 16:39:07.326579 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.326560 2571 generic.go:356] "Generic (PLEG): container finished" podID="aba6cd2f-7c70-47a3-a910-f257a7c09866" containerID="bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262" exitCode=0 Jun 07 16:39:07.326645 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.326599 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" Jun 07 16:39:07.326729 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.326701 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" event={"ID":"aba6cd2f-7c70-47a3-a910-f257a7c09866","Type":"ContainerDied","Data":"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262"} Jun 07 16:39:07.326784 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.326739 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4fcbs" event={"ID":"aba6cd2f-7c70-47a3-a910-f257a7c09866","Type":"ContainerDied","Data":"af97fc4b25f82cc14aadf42af7923b5896251750097ab958da4c96158a6c5c42"} Jun 07 16:39:07.333634 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.333618 2571 scope.go:117] "RemoveContainer" containerID="befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e" Jun 07 16:39:07.333925 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:39:07.333907 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e\": container with ID starting with befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e not found: ID does not exist" containerID="befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e" Jun 07 16:39:07.333991 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.333932 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e"} err="failed to get container status \"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e\": rpc error: code = NotFound desc = could not find container \"befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e\": container with ID starting with befdb572fb72f595713968e874ec0d70f4694be043be42e237f0db6c4308453e not found: ID does not exist" Jun 07 16:39:07.333991 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.333949 2571 scope.go:117] "RemoveContainer" containerID="bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262" Jun 07 16:39:07.341547 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.341536 2571 scope.go:117] "RemoveContainer" containerID="bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262" Jun 07 16:39:07.341828 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:39:07.341793 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262\": container with ID starting with bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262 not found: ID does not exist" containerID="bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262" Jun 07 16:39:07.341875 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.341836 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262"} err="failed to get container status \"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262\": rpc error: code = NotFound desc = could not find container \"bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262\": container with ID starting with bb48f975215b059b64c286a5ebb8e25c62f923b8cb15b2135545a1137052b262 not found: ID does not exist" Jun 07 16:39:07.348553 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.348533 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:39:07.354641 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.354622 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgksc"] Jun 07 16:39:07.364067 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.364049 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:07.367535 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.367515 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4fcbs"] Jun 07 16:39:07.446568 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.446546 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4920c60b-bc03-4bcd-be21-b7ff52595c99" path="/var/lib/kubelet/pods/4920c60b-bc03-4bcd-be21-b7ff52595c99/volumes" Jun 07 16:39:07.446902 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.446888 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="626a45f3-dd5e-4ef4-96c0-cdaa3f30f928" path="/var/lib/kubelet/pods/626a45f3-dd5e-4ef4-96c0-cdaa3f30f928/volumes" Jun 07 16:39:07.447084 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:07.447072 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba6cd2f-7c70-47a3-a910-f257a7c09866" path="/var/lib/kubelet/pods/aba6cd2f-7c70-47a3-a910-f257a7c09866/volumes" Jun 07 16:39:09.866584 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866548 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866867 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba6cd2f-7c70-47a3-a910-f257a7c09866" containerName="authorino" Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866878 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba6cd2f-7c70-47a3-a910-f257a7c09866" containerName="authorino" Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866906 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4920c60b-bc03-4bcd-be21-b7ff52595c99" containerName="authorino" Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866911 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4920c60b-bc03-4bcd-be21-b7ff52595c99" containerName="authorino" Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866959 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba6cd2f-7c70-47a3-a910-f257a7c09866" containerName="authorino" Jun 07 16:39:09.866984 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.866967 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4920c60b-bc03-4bcd-be21-b7ff52595c99" containerName="authorino" Jun 07 16:39:09.871245 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.871227 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:09.874843 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.874819 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 16:39:09.875055 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.875020 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:39:09.875789 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.875775 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bhw8s\"" Jun 07 16:39:09.880295 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:09.880274 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:10.029176 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.029126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8ncs\" (UniqueName: \"kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.029373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.029202 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.130275 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.130189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8ncs\" (UniqueName: \"kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.130275 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.130246 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.132662 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.132634 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.137773 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.137751 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8ncs\" (UniqueName: \"kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs\") pod \"maas-controller-7cd89d6878-rvphh\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.182789 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.182765 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:10.313442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.313403 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:10.316449 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:39:10.316423 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02fe0fc_e7e7_471d_9124_a85047ee2492.slice/crio-8a7bbc37c32e83d920b8ba74026ccf34141dd0855a0c3c9da8f962644078a9cd WatchSource:0}: Error finding container 8a7bbc37c32e83d920b8ba74026ccf34141dd0855a0c3c9da8f962644078a9cd: Status 404 returned error can't find the container with id 8a7bbc37c32e83d920b8ba74026ccf34141dd0855a0c3c9da8f962644078a9cd Jun 07 16:39:10.342554 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:10.342522 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cd89d6878-rvphh" event={"ID":"f02fe0fc-e7e7-471d-9124-a85047ee2492","Type":"ContainerStarted","Data":"8a7bbc37c32e83d920b8ba74026ccf34141dd0855a0c3c9da8f962644078a9cd"} Jun 07 16:39:13.359602 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:13.359562 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cd89d6878-rvphh" event={"ID":"f02fe0fc-e7e7-471d-9124-a85047ee2492","Type":"ContainerStarted","Data":"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8"} Jun 07 16:39:13.360076 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:13.359686 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:24.370442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.370411 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:24.387950 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.387903 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cd89d6878-rvphh" podStartSLOduration=12.936146958 podStartE2EDuration="15.387887308s" totalImagesPullingTime="2.45174035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:13.417634143 +0000 UTC m=+712.406524894" watchObservedRunningTime="2026-06-07 16:39:24.387887308 +0000 UTC m=+723.376778059" Jun 07 16:39:24.456602 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.456569 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:24.456757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.456733 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7cd89d6878-rvphh" podUID="f02fe0fc-e7e7-471d-9124-a85047ee2492" containerName="manager" containerID="cri-o://71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8" gracePeriod=30 Jun 07 16:39:24.688554 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.688530 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:24.856271 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.856242 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert\") pod \"f02fe0fc-e7e7-471d-9124-a85047ee2492\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " Jun 07 16:39:24.856442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.856293 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8ncs\" (UniqueName: \"kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs\") pod \"f02fe0fc-e7e7-471d-9124-a85047ee2492\" (UID: \"f02fe0fc-e7e7-471d-9124-a85047ee2492\") " Jun 07 16:39:24.858485 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.858461 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f02fe0fc-e7e7-471d-9124-a85047ee2492" (UID: "f02fe0fc-e7e7-471d-9124-a85047ee2492"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:39:24.858604 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.858578 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs" (OuterVolumeSpecName: "kube-api-access-s8ncs") pod "f02fe0fc-e7e7-471d-9124-a85047ee2492" (UID: "f02fe0fc-e7e7-471d-9124-a85047ee2492"). InnerVolumeSpecName "kube-api-access-s8ncs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:39:24.956961 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.956926 2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f02fe0fc-e7e7-471d-9124-a85047ee2492-webhook-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:39:24.956961 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:24.956961 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8ncs\" (UniqueName: \"kubernetes.io/projected/f02fe0fc-e7e7-471d-9124-a85047ee2492-kube-api-access-s8ncs\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:39:25.413036 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.412949 2571 generic.go:356] "Generic (PLEG): container finished" podID="f02fe0fc-e7e7-471d-9124-a85047ee2492" containerID="71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8" exitCode=0 Jun 07 16:39:25.413036 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.413006 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cd89d6878-rvphh" Jun 07 16:39:25.413518 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.413044 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cd89d6878-rvphh" event={"ID":"f02fe0fc-e7e7-471d-9124-a85047ee2492","Type":"ContainerDied","Data":"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8"} Jun 07 16:39:25.413518 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.413099 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cd89d6878-rvphh" event={"ID":"f02fe0fc-e7e7-471d-9124-a85047ee2492","Type":"ContainerDied","Data":"8a7bbc37c32e83d920b8ba74026ccf34141dd0855a0c3c9da8f962644078a9cd"} Jun 07 16:39:25.413518 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.413130 2571 scope.go:117] "RemoveContainer" containerID="71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8" Jun 07 16:39:25.422207 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.422190 2571 scope.go:117] "RemoveContainer" containerID="71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8" Jun 07 16:39:25.422480 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:39:25.422453 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8\": container with ID starting with 71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8 not found: ID does not exist" containerID="71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8" Jun 07 16:39:25.422537 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.422478 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8"} err="failed to get container status \"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8\": rpc error: code = NotFound desc = could not find container \"71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8\": container with ID starting with 71fe785009e0cf0deded5a1fe847cef28798f8526a2ec47507b7aa9e14e673d8 not found: ID does not exist" Jun 07 16:39:25.437882 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.437857 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:25.440847 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.440829 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cd89d6878-rvphh"] Jun 07 16:39:25.451327 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:25.451300 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02fe0fc-e7e7-471d-9124-a85047ee2492" path="/var/lib/kubelet/pods/f02fe0fc-e7e7-471d-9124-a85047ee2492/volumes" Jun 07 16:39:44.576292 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.576257 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jhwqt"] Jun 07 16:39:44.576662 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.576559 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02fe0fc-e7e7-471d-9124-a85047ee2492" containerName="manager" Jun 07 16:39:44.576662 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.576570 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02fe0fc-e7e7-471d-9124-a85047ee2492" containerName="manager" Jun 07 16:39:44.576662 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.576644 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02fe0fc-e7e7-471d-9124-a85047ee2492" containerName="manager" Jun 07 16:39:44.578655 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.578637 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:44.581134 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.581111 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 07 16:39:44.581240 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.581117 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-487ds\"" Jun 07 16:39:44.587932 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.587914 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jhwqt"] Jun 07 16:39:44.600979 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.600943 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xj7\" (UniqueName: \"kubernetes.io/projected/74f84e19-6dce-4e59-90d2-ae50f72dffd0-kube-api-access-v5xj7\") pod \"payload-processing-7c6c859784-jhwqt\" (UID: \"74f84e19-6dce-4e59-90d2-ae50f72dffd0\") " pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:44.702495 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.702462 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xj7\" (UniqueName: \"kubernetes.io/projected/74f84e19-6dce-4e59-90d2-ae50f72dffd0-kube-api-access-v5xj7\") pod \"payload-processing-7c6c859784-jhwqt\" (UID: \"74f84e19-6dce-4e59-90d2-ae50f72dffd0\") " pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:44.716813 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.716783 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xj7\" (UniqueName: \"kubernetes.io/projected/74f84e19-6dce-4e59-90d2-ae50f72dffd0-kube-api-access-v5xj7\") pod \"payload-processing-7c6c859784-jhwqt\" (UID: \"74f84e19-6dce-4e59-90d2-ae50f72dffd0\") " pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:44.889057 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:44.888970 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:45.018001 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:45.017951 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jhwqt"] Jun 07 16:39:45.020224 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:39:45.020200 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f84e19_6dce_4e59_90d2_ae50f72dffd0.slice/crio-5785a1720a587fd7ee75bf97514c2dac26614bb499bac7177e6df237f35a5394 WatchSource:0}: Error finding container 5785a1720a587fd7ee75bf97514c2dac26614bb499bac7177e6df237f35a5394: Status 404 returned error can't find the container with id 5785a1720a587fd7ee75bf97514c2dac26614bb499bac7177e6df237f35a5394 Jun 07 16:39:45.500254 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:45.500206 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" event={"ID":"74f84e19-6dce-4e59-90d2-ae50f72dffd0","Type":"ContainerStarted","Data":"5785a1720a587fd7ee75bf97514c2dac26614bb499bac7177e6df237f35a5394"} Jun 07 16:39:46.506865 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:46.506823 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" event={"ID":"74f84e19-6dce-4e59-90d2-ae50f72dffd0","Type":"ContainerStarted","Data":"ff485b42d446638619edfe06d14b47afdb59a3485764cc040a14f65ddd93bf87"} Jun 07 16:39:46.507314 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:46.506914 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:39:46.523101 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:46.523054 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" podStartSLOduration=1.269869469 podStartE2EDuration="2.523040049s" totalImagesPullingTime="1.25317058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:46.521734562 +0000 UTC m=+745.510625310" watchObservedRunningTime="2026-06-07 16:39:46.523040049 +0000 UTC m=+745.511930792" Jun 07 16:39:57.514283 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:39:57.514254 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jhwqt" Jun 07 16:40:31.869944 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.869912 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:40:31.874632 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.874608 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:31.877185 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.877167 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 07 16:40:31.883062 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.883040 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:40:31.902637 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.902613 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:31.902757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.902645 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:31.902757 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:31.902674 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfbd\" (UniqueName: \"kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.003460 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.003432 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.003571 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.003466 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.003614 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.003589 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfbd\" (UniqueName: \"kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.004155 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.004140 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.005950 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.005933 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.011509 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.011488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfbd\" (UniqueName: \"kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd\") pod \"authorino-7dccccf79f-whqbr\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.184598 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.184528 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:40:32.320601 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.320579 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:40:32.322645 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:40:32.322615 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2de54731_a69c_47b8_bde7_88844efb6e1a.slice/crio-2a16c26c7897a5aeba99360108206ce042bb2b07f0c78b4a5e2433ea5db19a8f WatchSource:0}: Error finding container 2a16c26c7897a5aeba99360108206ce042bb2b07f0c78b4a5e2433ea5db19a8f: Status 404 returned error can't find the container with id 2a16c26c7897a5aeba99360108206ce042bb2b07f0c78b4a5e2433ea5db19a8f Jun 07 16:40:32.324075 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.324056 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:40:32.708046 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:32.708011 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dccccf79f-whqbr" event={"ID":"2de54731-a69c-47b8-bde7-88844efb6e1a","Type":"ContainerStarted","Data":"2a16c26c7897a5aeba99360108206ce042bb2b07f0c78b4a5e2433ea5db19a8f"} Jun 07 16:40:33.713537 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:33.713506 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dccccf79f-whqbr" event={"ID":"2de54731-a69c-47b8-bde7-88844efb6e1a","Type":"ContainerStarted","Data":"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932"} Jun 07 16:40:33.729338 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:33.729292 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dccccf79f-whqbr" podStartSLOduration=2.308138823 podStartE2EDuration="2.729279088s" totalImagesPullingTime="421.140265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:40:33.727991907 +0000 UTC m=+792.716882661" watchObservedRunningTime="2026-06-07 16:40:33.729279088 +0000 UTC m=+792.718169839" Jun 07 16:40:33.752000 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:33.751971 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:40:33.752146 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:33.752128 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57c4f68767-7ss68" podUID="77a63322-943b-48d1-abcc-61265d7ed48b" containerName="authorino" containerID="cri-o://fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6" gracePeriod=30 Jun 07 16:40:34.020952 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.020920 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:40:34.118105 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.118080 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert\") pod \"77a63322-943b-48d1-abcc-61265d7ed48b\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " Jun 07 16:40:34.118248 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.118133 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zldfl\" (UniqueName: \"kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl\") pod \"77a63322-943b-48d1-abcc-61265d7ed48b\" (UID: \"77a63322-943b-48d1-abcc-61265d7ed48b\") " Jun 07 16:40:34.120162 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.120138 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl" (OuterVolumeSpecName: "kube-api-access-zldfl") pod "77a63322-943b-48d1-abcc-61265d7ed48b" (UID: "77a63322-943b-48d1-abcc-61265d7ed48b"). InnerVolumeSpecName "kube-api-access-zldfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:40:34.128246 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.128221 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "77a63322-943b-48d1-abcc-61265d7ed48b" (UID: "77a63322-943b-48d1-abcc-61265d7ed48b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:40:34.219181 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.219157 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zldfl\" (UniqueName: \"kubernetes.io/projected/77a63322-943b-48d1-abcc-61265d7ed48b-kube-api-access-zldfl\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:40:34.219181 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.219180 2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77a63322-943b-48d1-abcc-61265d7ed48b-tls-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:40:34.719848 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.719797 2571 generic.go:356] "Generic (PLEG): container finished" podID="77a63322-943b-48d1-abcc-61265d7ed48b" containerID="fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6" exitCode=0 Jun 07 16:40:34.720274 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.719863 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c4f68767-7ss68" Jun 07 16:40:34.720274 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.719899 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c4f68767-7ss68" event={"ID":"77a63322-943b-48d1-abcc-61265d7ed48b","Type":"ContainerDied","Data":"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6"} Jun 07 16:40:34.720274 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.719938 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c4f68767-7ss68" event={"ID":"77a63322-943b-48d1-abcc-61265d7ed48b","Type":"ContainerDied","Data":"f6bf95ed0ddf9d018d426371a4c7976eed0543b72f768d33a78c7a2f9620c91e"} Jun 07 16:40:34.720274 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.719956 2571 scope.go:117] "RemoveContainer" containerID="fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6" Jun 07 16:40:34.728633 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.728619 2571 scope.go:117] "RemoveContainer" containerID="fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6" Jun 07 16:40:34.728892 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:40:34.728873 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6\": container with ID starting with fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6 not found: ID does not exist" containerID="fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6" Jun 07 16:40:34.728972 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.728898 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6"} err="failed to get container status \"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6\": rpc error: code = NotFound desc = could not find container \"fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6\": container with ID starting with fba4204ea39608229467f3838a06f2bd158b106ef94f6fd7454806a97cf45dc6 not found: ID does not exist" Jun 07 16:40:34.741047 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.741023 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:40:34.745358 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:34.745341 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57c4f68767-7ss68"] Jun 07 16:40:35.446219 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:35.446188 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a63322-943b-48d1-abcc-61265d7ed48b" path="/var/lib/kubelet/pods/77a63322-943b-48d1-abcc-61265d7ed48b/volumes" Jun 07 16:40:52.798576 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.798538 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h"] Jun 07 16:40:52.799080 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.799059 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a63322-943b-48d1-abcc-61265d7ed48b" containerName="authorino" Jun 07 16:40:52.799152 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.799084 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a63322-943b-48d1-abcc-61265d7ed48b" containerName="authorino" Jun 07 16:40:52.799206 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.799195 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a63322-943b-48d1-abcc-61265d7ed48b" containerName="authorino" Jun 07 16:40:52.802566 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.802545 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.805015 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.804993 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:40:52.805261 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.805243 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:40:52.805333 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.805280 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bcmch\"" Jun 07 16:40:52.806099 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.806079 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 07 16:40:52.813206 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.813183 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h"] Jun 07 16:40:52.887140 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.887284 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887170 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.887284 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887195 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.887284 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887224 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d51cd3b-0148-4c65-9c55-d352f90fd270-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.887284 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887262 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqprr\" (UniqueName: \"kubernetes.io/projected/3d51cd3b-0148-4c65-9c55-d352f90fd270-kube-api-access-jqprr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.887438 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.887309 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.988668 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988637 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d51cd3b-0148-4c65-9c55-d352f90fd270-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.988788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqprr\" (UniqueName: \"kubernetes.io/projected/3d51cd3b-0148-4c65-9c55-d352f90fd270-kube-api-access-jqprr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.988788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.988788 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988747 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.988962 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988931 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.989015 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.988987 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.989207 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.989183 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.989280 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.989224 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.989280 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.989251 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.991228 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.991200 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d51cd3b-0148-4c65-9c55-d352f90fd270-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.991331 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.991316 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d51cd3b-0148-4c65-9c55-d352f90fd270-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:52.997884 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:52.997864 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqprr\" (UniqueName: \"kubernetes.io/projected/3d51cd3b-0148-4c65-9c55-d352f90fd270-kube-api-access-jqprr\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-5jw2h\" (UID: \"3d51cd3b-0148-4c65-9c55-d352f90fd270\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:53.112938 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:53.112836 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:40:53.246211 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:53.246188 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h"] Jun 07 16:40:53.248897 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:40:53.248861 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d51cd3b_0148_4c65_9c55_d352f90fd270.slice/crio-31c091055cefa1f3bea12bb4d137604e26f95569343af89e7d6e8a2ad9e64fa2 WatchSource:0}: Error finding container 31c091055cefa1f3bea12bb4d137604e26f95569343af89e7d6e8a2ad9e64fa2: Status 404 returned error can't find the container with id 31c091055cefa1f3bea12bb4d137604e26f95569343af89e7d6e8a2ad9e64fa2 Jun 07 16:40:53.808899 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:53.808863 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" event={"ID":"3d51cd3b-0148-4c65-9c55-d352f90fd270","Type":"ContainerStarted","Data":"31c091055cefa1f3bea12bb4d137604e26f95569343af89e7d6e8a2ad9e64fa2"} Jun 07 16:40:56.826309 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:40:56.826268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" event={"ID":"3d51cd3b-0148-4c65-9c55-d352f90fd270","Type":"ContainerStarted","Data":"cf93a708c2865a92ea5419eac2e7465e3bdb49b6f11c57fc03aa029ba8b0ac28"} Jun 07 16:41:36.623583 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.623547 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll"] Jun 07 16:41:36.626692 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.626676 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.630338 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.630318 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 07 16:41:36.639363 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.639344 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll"] Jun 07 16:41:36.773905 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.773877 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.774063 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.773937 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.774063 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.773974 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.774063 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.773995 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h89lt\" (UniqueName: \"kubernetes.io/projected/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kube-api-access-h89lt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.774063 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.774016 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.774203 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.774091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.874861 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.874861 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874845 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875044 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874877 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h89lt\" (UniqueName: \"kubernetes.io/projected/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kube-api-access-h89lt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875044 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874899 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875044 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874919 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875044 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.874943 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875323 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.875291 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875424 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.875330 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.875424 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.875360 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.877048 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.877023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.877396 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.877380 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.885089 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.885068 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h89lt\" (UniqueName: \"kubernetes.io/projected/47a7a91e-fde4-4056-9b2b-3f1fa80737bf-kube-api-access-h89lt\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9m5ll\" (UID: \"47a7a91e-fde4-4056-9b2b-3f1fa80737bf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:36.936184 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:36.936144 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:41:37.094686 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:37.094658 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll"] Jun 07 16:41:37.097393 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:41:37.097361 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a7a91e_fde4_4056_9b2b_3f1fa80737bf.slice/crio-2cf4c2b5d8122067fb0a7e33ede74e8c8daf106870766b42efb01997b93e7b35 WatchSource:0}: Error finding container 2cf4c2b5d8122067fb0a7e33ede74e8c8daf106870766b42efb01997b93e7b35: Status 404 returned error can't find the container with id 2cf4c2b5d8122067fb0a7e33ede74e8c8daf106870766b42efb01997b93e7b35 Jun 07 16:41:38.018037 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:38.017996 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" event={"ID":"47a7a91e-fde4-4056-9b2b-3f1fa80737bf","Type":"ContainerStarted","Data":"2c994d6d7aac116b807289f9ff6664e6d77a4dfeb31e39ac5a6b1fb05ea7b1ab"} Jun 07 16:41:38.018432 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:41:38.018050 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" event={"ID":"47a7a91e-fde4-4056-9b2b-3f1fa80737bf","Type":"ContainerStarted","Data":"2cf4c2b5d8122067fb0a7e33ede74e8c8daf106870766b42efb01997b93e7b35"} Jun 07 16:42:21.703964 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:21.703939 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:42:21.708825 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:21.705265 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:42:31.255362 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:31.255329 2571 generic.go:356] "Generic (PLEG): container finished" podID="47a7a91e-fde4-4056-9b2b-3f1fa80737bf" containerID="2c994d6d7aac116b807289f9ff6664e6d77a4dfeb31e39ac5a6b1fb05ea7b1ab" exitCode=0 Jun 07 16:42:31.255823 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:31.255387 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" event={"ID":"47a7a91e-fde4-4056-9b2b-3f1fa80737bf","Type":"ContainerDied","Data":"2c994d6d7aac116b807289f9ff6664e6d77a4dfeb31e39ac5a6b1fb05ea7b1ab"} Jun 07 16:42:33.266257 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:33.266221 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" event={"ID":"47a7a91e-fde4-4056-9b2b-3f1fa80737bf","Type":"ContainerStarted","Data":"84eb5e011406b3f929e35ad38e6f0ca07732288a136df6c40aad7c57a764298d"} Jun 07 16:42:33.286384 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:33.286340 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" podStartSLOduration=2.761438527 podStartE2EDuration="57.286326019s" totalImagesPullingTime="1.01320152s" totalInitContainerRuntime="53.511685972s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:42:33.28568594 +0000 UTC m=+912.274576694" watchObservedRunningTime="2026-06-07 16:42:33.286326019 +0000 UTC m=+912.275216770" Jun 07 16:42:36.936674 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:36.936635 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:42:36.936674 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:36.936682 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:42:36.949107 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:36.949085 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:42:37.295452 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:37.295427 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9m5ll" Jun 07 16:42:38.449149 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.449114 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c545d7d8b-2pkqf"] Jun 07 16:42:38.452404 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.452387 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.459448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.459426 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c545d7d8b-2pkqf"] Jun 07 16:42:38.521500 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.521254 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2sfp\" (UniqueName: \"kubernetes.io/projected/cfac2c5a-2791-4b36-a278-998916f9f499-kube-api-access-b2sfp\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.521500 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.521317 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfac2c5a-2791-4b36-a278-998916f9f499-tls-cert\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.521500 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.521344 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/cfac2c5a-2791-4b36-a278-998916f9f499-oidc-ca\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.621925 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.621896 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2sfp\" (UniqueName: \"kubernetes.io/projected/cfac2c5a-2791-4b36-a278-998916f9f499-kube-api-access-b2sfp\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.622050 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.621935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfac2c5a-2791-4b36-a278-998916f9f499-tls-cert\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.622050 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.621951 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/cfac2c5a-2791-4b36-a278-998916f9f499-oidc-ca\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.622499 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.622482 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/cfac2c5a-2791-4b36-a278-998916f9f499-oidc-ca\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.624519 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.624498 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfac2c5a-2791-4b36-a278-998916f9f499-tls-cert\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.630504 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.630482 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2sfp\" (UniqueName: \"kubernetes.io/projected/cfac2c5a-2791-4b36-a278-998916f9f499-kube-api-access-b2sfp\") pod \"authorino-c545d7d8b-2pkqf\" (UID: \"cfac2c5a-2791-4b36-a278-998916f9f499\") " pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.761566 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.761528 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c545d7d8b-2pkqf" Jun 07 16:42:38.890585 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:38.890562 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c545d7d8b-2pkqf"] Jun 07 16:42:38.893353 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:42:38.893328 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfac2c5a_2791_4b36_a278_998916f9f499.slice/crio-1a9b9128a3b1f923d100612f365789c7b298bcc3cb9811d3c6588092f7fb6225 WatchSource:0}: Error finding container 1a9b9128a3b1f923d100612f365789c7b298bcc3cb9811d3c6588092f7fb6225: Status 404 returned error can't find the container with id 1a9b9128a3b1f923d100612f365789c7b298bcc3cb9811d3c6588092f7fb6225 Jun 07 16:42:39.293834 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:39.293783 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c545d7d8b-2pkqf" event={"ID":"cfac2c5a-2791-4b36-a278-998916f9f499","Type":"ContainerStarted","Data":"1a9b9128a3b1f923d100612f365789c7b298bcc3cb9811d3c6588092f7fb6225"} Jun 07 16:42:40.299983 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.299949 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c545d7d8b-2pkqf" event={"ID":"cfac2c5a-2791-4b36-a278-998916f9f499","Type":"ContainerStarted","Data":"f9ec8e6477291e59f9e73911829a3535322d65619203a60017c01e7aa04e02f7"} Jun 07 16:42:40.315339 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.315295 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c545d7d8b-2pkqf" podStartSLOduration=1.915403645 podStartE2EDuration="2.315280608s" totalImagesPullingTime="399.876963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:42:40.31341778 +0000 UTC m=+919.302308532" watchObservedRunningTime="2026-06-07 16:42:40.315280608 +0000 UTC m=+919.304171360" Jun 07 16:42:40.338913 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.338886 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:42:40.339087 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.339065 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7dccccf79f-whqbr" podUID="2de54731-a69c-47b8-bde7-88844efb6e1a" containerName="authorino" containerID="cri-o://19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932" gracePeriod=30 Jun 07 16:42:40.600781 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.600759 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:42:40.639844 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.639790 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkfbd\" (UniqueName: \"kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd\") pod \"2de54731-a69c-47b8-bde7-88844efb6e1a\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " Jun 07 16:42:40.639982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.639915 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert\") pod \"2de54731-a69c-47b8-bde7-88844efb6e1a\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " Jun 07 16:42:40.639982 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.639951 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca\") pod \"2de54731-a69c-47b8-bde7-88844efb6e1a\" (UID: \"2de54731-a69c-47b8-bde7-88844efb6e1a\") " Jun 07 16:42:40.641954 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.641925 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd" (OuterVolumeSpecName: "kube-api-access-hkfbd") pod "2de54731-a69c-47b8-bde7-88844efb6e1a" (UID: "2de54731-a69c-47b8-bde7-88844efb6e1a"). InnerVolumeSpecName "kube-api-access-hkfbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:42:40.645838 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.645795 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "2de54731-a69c-47b8-bde7-88844efb6e1a" (UID: "2de54731-a69c-47b8-bde7-88844efb6e1a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:42:40.650019 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.649992 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2de54731-a69c-47b8-bde7-88844efb6e1a" (UID: "2de54731-a69c-47b8-bde7-88844efb6e1a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:42:40.740908 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.740876 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkfbd\" (UniqueName: \"kubernetes.io/projected/2de54731-a69c-47b8-bde7-88844efb6e1a-kube-api-access-hkfbd\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:42:40.740908 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.740901 2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2de54731-a69c-47b8-bde7-88844efb6e1a-tls-cert\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:42:40.741062 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:40.740911 2571 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2de54731-a69c-47b8-bde7-88844efb6e1a-oidc-ca\") on node \"ip-10-0-140-203.ec2.internal\" DevicePath \"\"" Jun 07 16:42:41.305364 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.305328 2571 generic.go:356] "Generic (PLEG): container finished" podID="2de54731-a69c-47b8-bde7-88844efb6e1a" containerID="19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932" exitCode=0 Jun 07 16:42:41.305782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.305371 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dccccf79f-whqbr" Jun 07 16:42:41.305782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.305405 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dccccf79f-whqbr" event={"ID":"2de54731-a69c-47b8-bde7-88844efb6e1a","Type":"ContainerDied","Data":"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932"} Jun 07 16:42:41.305782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.305434 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dccccf79f-whqbr" event={"ID":"2de54731-a69c-47b8-bde7-88844efb6e1a","Type":"ContainerDied","Data":"2a16c26c7897a5aeba99360108206ce042bb2b07f0c78b4a5e2433ea5db19a8f"} Jun 07 16:42:41.305782 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.305450 2571 scope.go:117] "RemoveContainer" containerID="19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932" Jun 07 16:42:41.315334 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.315319 2571 scope.go:117] "RemoveContainer" containerID="19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932" Jun 07 16:42:41.315584 ip-10-0-140-203 kubenswrapper[2571]: E0607 16:42:41.315563 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932\": container with ID starting with 19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932 not found: ID does not exist" containerID="19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932" Jun 07 16:42:41.315675 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.315589 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932"} err="failed to get container status \"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932\": rpc error: code = NotFound desc = could not find container \"19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932\": container with ID starting with 19840733ac6e15ec884ccc632024145225e08dc48343b1de231cab9798132932 not found: ID does not exist" Jun 07 16:42:41.326647 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.326624 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:42:41.329011 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.328990 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7dccccf79f-whqbr"] Jun 07 16:42:41.446194 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:42:41.446166 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de54731-a69c-47b8-bde7-88844efb6e1a" path="/var/lib/kubelet/pods/2de54731-a69c-47b8-bde7-88844efb6e1a/volumes" Jun 07 16:44:09.085779 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.085683 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5886cdb686-jjh5j"] Jun 07 16:44:09.086397 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.086192 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de54731-a69c-47b8-bde7-88844efb6e1a" containerName="authorino" Jun 07 16:44:09.086397 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.086211 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de54731-a69c-47b8-bde7-88844efb6e1a" containerName="authorino" Jun 07 16:44:09.086397 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.086323 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de54731-a69c-47b8-bde7-88844efb6e1a" containerName="authorino" Jun 07 16:44:09.089320 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.089299 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.092647 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.092625 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 16:44:09.092768 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.092655 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bhw8s\"" Jun 07 16:44:09.092768 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.092657 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 16:44:09.100113 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.100095 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5886cdb686-jjh5j"] Jun 07 16:44:09.202516 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.202490 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzxx\" (UniqueName: \"kubernetes.io/projected/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-kube-api-access-thzxx\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.202651 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.202540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-webhook-cert\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.303321 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.303287 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzxx\" (UniqueName: \"kubernetes.io/projected/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-kube-api-access-thzxx\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.303482 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.303344 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-webhook-cert\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.306030 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.306010 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-webhook-cert\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.312313 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.312292 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzxx\" (UniqueName: \"kubernetes.io/projected/ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7-kube-api-access-thzxx\") pod \"maas-controller-5886cdb686-jjh5j\" (UID: \"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7\") " pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.400393 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.400313 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:09.535391 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.535362 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5886cdb686-jjh5j"] Jun 07 16:44:09.536787 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:44:09.536744 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3ed8ae_5d92_4a5a_a08d_cdd0499248a7.slice/crio-81eee221e67f1905e679eb7455139b133922c511507dac763fb0fa51e0e48edd WatchSource:0}: Error finding container 81eee221e67f1905e679eb7455139b133922c511507dac763fb0fa51e0e48edd: Status 404 returned error can't find the container with id 81eee221e67f1905e679eb7455139b133922c511507dac763fb0fa51e0e48edd Jun 07 16:44:09.711037 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:09.711002 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-jjh5j" event={"ID":"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7","Type":"ContainerStarted","Data":"81eee221e67f1905e679eb7455139b133922c511507dac763fb0fa51e0e48edd"} Jun 07 16:44:10.718197 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:10.718164 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5886cdb686-jjh5j" event={"ID":"ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7","Type":"ContainerStarted","Data":"26f06f5e93e2ea722963af3ac7ec0b3ad859592d8f26b77dea2f9dfd0f8c5061"} Jun 07 16:44:10.718565 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:10.718227 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:10.734893 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:10.734851 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5886cdb686-jjh5j" podStartSLOduration=1.412204003 podStartE2EDuration="1.734835652s" totalImagesPullingTime="322.631649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:44:10.732654741 +0000 UTC m=+1009.721545492" watchObservedRunningTime="2026-06-07 16:44:10.734835652 +0000 UTC m=+1009.723726404" Jun 07 16:44:16.751520 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:16.751485 2571 generic.go:356] "Generic (PLEG): container finished" podID="3d51cd3b-0148-4c65-9c55-d352f90fd270" containerID="cf93a708c2865a92ea5419eac2e7465e3bdb49b6f11c57fc03aa029ba8b0ac28" exitCode=0 Jun 07 16:44:16.751922 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:16.751556 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" event={"ID":"3d51cd3b-0148-4c65-9c55-d352f90fd270","Type":"ContainerDied","Data":"cf93a708c2865a92ea5419eac2e7465e3bdb49b6f11c57fc03aa029ba8b0ac28"} Jun 07 16:44:17.757589 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:17.757556 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" event={"ID":"3d51cd3b-0148-4c65-9c55-d352f90fd270","Type":"ContainerStarted","Data":"0c82f6b315e66a462fb7d272acac3082905e4bb04ed4127f6be7f36b11bd96a7"} Jun 07 16:44:17.779528 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:17.779480 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" podStartSLOduration=2.5078727 podStartE2EDuration="3m25.779463011s" totalImagesPullingTime="2.827272631s" totalInitContainerRuntime="3m20.44431768s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:40:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:44:17.778277761 +0000 UTC m=+1016.767168518" watchObservedRunningTime="2026-06-07 16:44:17.779463011 +0000 UTC m=+1016.768353762" Jun 07 16:44:21.727267 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:21.727238 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5886cdb686-jjh5j" Jun 07 16:44:23.113372 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:23.113327 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:44:23.113859 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:23.113435 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:44:23.126205 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:23.126183 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:44:23.797624 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:44:23.797596 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-5jw2h" Jun 07 16:47:08.134357 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:08.134271 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c545d7d8b-2pkqf_cfac2c5a-2791-4b36-a278-998916f9f499/authorino/0.log" Jun 07 16:47:13.162448 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:13.162410 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5886cdb686-jjh5j_ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7/manager/0.log" Jun 07 16:47:13.776906 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:13.776874 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-sjhx4_05b0554d-a8d9-4199-9eb0-ed28381363d1/manager/0.log" Jun 07 16:47:13.784226 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:13.784203 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-sjhx4_05b0554d-a8d9-4199-9eb0-ed28381363d1/copy-manifests/0.log" Jun 07 16:47:15.036595 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:15.036568 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c545d7d8b-2pkqf_cfac2c5a-2791-4b36-a278-998916f9f499/authorino/0.log" Jun 07 16:47:15.376442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:15.376370 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jh4kc_5e4a6178-5760-43f8-a963-ae23ca87324c/kuadrant-console-plugin/0.log" Jun 07 16:47:15.857119 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:15.857091 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gdkcb_45ed6f13-e3cc-48e6-824c-6be960baa58f/manager/0.log" Jun 07 16:47:16.556790 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:16.556762 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-ts5kl_2b4089a9-5e2c-40ab-9305-15ad5eb91054/kube-auth-proxy/0.log" Jun 07 16:47:16.919325 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:16.919215 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jhwqt_74f84e19-6dce-4e59-90d2-ae50f72dffd0/payload-processing/0.log" Jun 07 16:47:17.028685 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:17.028658 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f75767cf5-gqgpp_2a5337ba-2832-4e97-8730-5fac0b5cae54/router/0.log" Jun 07 16:47:17.499759 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:17.499729 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-5jw2h_3d51cd3b-0148-4c65-9c55-d352f90fd270/storage-initializer/0.log" Jun 07 16:47:17.507111 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:17.507088 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-5jw2h_3d51cd3b-0148-4c65-9c55-d352f90fd270/main/0.log" Jun 07 16:47:17.978289 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:17.978259 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9m5ll_47a7a91e-fde4-4056-9b2b-3f1fa80737bf/storage-initializer/0.log" Jun 07 16:47:17.985705 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:17.985680 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9m5ll_47a7a91e-fde4-4056-9b2b-3f1fa80737bf/main/0.log" Jun 07 16:47:21.716026 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.715916 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nhgnq/must-gather-t6jxk"] Jun 07 16:47:21.720578 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.720338 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.724419 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.724394 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"openshift-service-ca.crt\"" Jun 07 16:47:21.724569 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.724461 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nhgnq\"/\"default-dockercfg-2z7nd\"" Jun 07 16:47:21.727100 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.725527 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"kube-root-ca.crt\"" Jun 07 16:47:21.730785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.730758 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/must-gather-t6jxk"] Jun 07 16:47:21.754849 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.754827 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:47:21.755363 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.755346 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9787q_00fe385a-2d6f-4b00-9983-5e910ff876ef/ovn-acl-logging/0.log" Jun 07 16:47:21.820011 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.819983 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/022e38a2-68b6-4de7-a31b-ffe0ec39d186-must-gather-output\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.820130 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.820013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pq72\" (UniqueName: \"kubernetes.io/projected/022e38a2-68b6-4de7-a31b-ffe0ec39d186-kube-api-access-5pq72\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.920978 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.920948 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/022e38a2-68b6-4de7-a31b-ffe0ec39d186-must-gather-output\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.921085 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.920980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pq72\" (UniqueName: \"kubernetes.io/projected/022e38a2-68b6-4de7-a31b-ffe0ec39d186-kube-api-access-5pq72\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.921281 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.921263 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/022e38a2-68b6-4de7-a31b-ffe0ec39d186-must-gather-output\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:21.928478 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:21.928454 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pq72\" (UniqueName: \"kubernetes.io/projected/022e38a2-68b6-4de7-a31b-ffe0ec39d186-kube-api-access-5pq72\") pod \"must-gather-t6jxk\" (UID: \"022e38a2-68b6-4de7-a31b-ffe0ec39d186\") " pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:22.040213 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:22.040158 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" Jun 07 16:47:22.176869 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:22.176845 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/must-gather-t6jxk"] Jun 07 16:47:22.178873 ip-10-0-140-203 kubenswrapper[2571]: W0607 16:47:22.178843 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod022e38a2_68b6_4de7_a31b_ffe0ec39d186.slice/crio-6c386f366785b113f1f2373047fa74bfc88cbe37474bba5ecf0de0e317223977 WatchSource:0}: Error finding container 6c386f366785b113f1f2373047fa74bfc88cbe37474bba5ecf0de0e317223977: Status 404 returned error can't find the container with id 6c386f366785b113f1f2373047fa74bfc88cbe37474bba5ecf0de0e317223977 Jun 07 16:47:22.180754 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:22.180730 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:47:22.603408 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:22.603372 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" event={"ID":"022e38a2-68b6-4de7-a31b-ffe0ec39d186","Type":"ContainerStarted","Data":"6c386f366785b113f1f2373047fa74bfc88cbe37474bba5ecf0de0e317223977"} Jun 07 16:47:23.612988 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:23.612950 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" event={"ID":"022e38a2-68b6-4de7-a31b-ffe0ec39d186","Type":"ContainerStarted","Data":"23cac31027cbaf911195453a159ec97f9da73f6aa51f80e1be6a6565c4755ba9"} Jun 07 16:47:23.613424 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:23.613005 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" event={"ID":"022e38a2-68b6-4de7-a31b-ffe0ec39d186","Type":"ContainerStarted","Data":"ecef0745f0ef7ea3c450c5ec9b6089d3e4f711c3a0b1911525419a7a2c9755ea"} Jun 07 16:47:23.631108 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:23.631051 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nhgnq/must-gather-t6jxk" podStartSLOduration=1.883826349 podStartE2EDuration="2.631028934s" totalImagesPullingTime="747.202585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:47:23.628158452 +0000 UTC m=+1202.617049265" watchObservedRunningTime="2026-06-07 16:47:23.631028934 +0000 UTC m=+1202.619919687" Jun 07 16:47:24.523541 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:24.523510 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cm5mb_d5a8596a-458b-4209-a487-f7c983032b79/global-pull-secret-syncer/0.log" Jun 07 16:47:24.702681 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:24.702654 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kt4xf_27ff00bb-1b24-4b1a-af98-20b2ed8b4df3/konnectivity-agent/0.log" Jun 07 16:47:24.772094 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:24.772066 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-203.ec2.internal_1a1861c4be82b6aa960b9ea3296f37a0/haproxy/0.log" Jun 07 16:47:29.804500 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:29.804459 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c545d7d8b-2pkqf_cfac2c5a-2791-4b36-a278-998916f9f499/authorino/0.log" Jun 07 16:47:29.909132 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:29.909101 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jh4kc_5e4a6178-5760-43f8-a963-ae23ca87324c/kuadrant-console-plugin/0.log" Jun 07 16:47:30.049762 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:30.049729 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gdkcb_45ed6f13-e3cc-48e6-824c-6be960baa58f/manager/0.log" Jun 07 16:47:32.106221 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.106191 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-557ccdc645-bnh9n_8578cdb2-9cf0-4abb-9206-5909b01add1f/metrics-server/0.log" Jun 07 16:47:32.173008 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.172983 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-8v4rb_d7a9ca5b-ec35-4604-b2e2-21433ee47fd4/monitoring-plugin/0.log" Jun 07 16:47:32.503049 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.502944 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/node-exporter/0.log" Jun 07 16:47:32.555185 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.555132 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/kube-rbac-proxy/0.log" Jun 07 16:47:32.591039 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.591006 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rpn4s_b300f8f1-5edb-4654-b015-d27573f004fc/init-textfile/0.log" Jun 07 16:47:32.804127 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.803996 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/prometheus/0.log" Jun 07 16:47:32.831819 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.831699 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/config-reloader/0.log" Jun 07 16:47:32.853718 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.853653 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/thanos-sidecar/0.log" Jun 07 16:47:32.879562 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.879534 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy-web/0.log" Jun 07 16:47:32.902785 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.902753 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy/0.log" Jun 07 16:47:32.926774 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.926746 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/kube-rbac-proxy-thanos/0.log" Jun 07 16:47:32.959504 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:32.959479 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64900064-6a0b-44e0-ba54-b75e48d64c1d/init-config-reloader/0.log" Jun 07 16:47:34.427258 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:34.427230 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-pp552_07011e4e-352f-4148-a8ad-2bdedb5de004/networking-console-plugin/0.log" Jun 07 16:47:35.240056 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.240017 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f"] Jun 07 16:47:35.245410 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.245380 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.254253 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.254191 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f"] Jun 07 16:47:35.370306 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.370269 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-proc\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.370494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.370359 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbwx\" (UniqueName: \"kubernetes.io/projected/40cbc63f-ce22-4c16-95fd-0df42c5f475e-kube-api-access-sdbwx\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.370494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.370416 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-podres\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.370494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.370454 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-lib-modules\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.370494 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.370481 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-sys\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.471981 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.471946 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-lib-modules\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.471989 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-sys\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472048 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-proc\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472110 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbwx\" (UniqueName: \"kubernetes.io/projected/40cbc63f-ce22-4c16-95fd-0df42c5f475e-kube-api-access-sdbwx\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472136 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-lib-modules\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472150 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-sys\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472193 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-podres\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472226 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-proc\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.472445 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.472336 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cbc63f-ce22-4c16-95fd-0df42c5f475e-podres\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.492522 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.492452 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbwx\" (UniqueName: \"kubernetes.io/projected/40cbc63f-ce22-4c16-95fd-0df42c5f475e-kube-api-access-sdbwx\") pod \"perf-node-gather-daemonset-r455f\" (UID: \"40cbc63f-ce22-4c16-95fd-0df42c5f475e\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.564442 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.564408 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:35.604329 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.604261 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hhsdr_a045a83d-fa63-4631-8bb1-6c1fa4d4b342/download-server/0.log" Jun 07 16:47:35.759175 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:35.758314 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f"] Jun 07 16:47:36.708880 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:36.708841 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" event={"ID":"40cbc63f-ce22-4c16-95fd-0df42c5f475e","Type":"ContainerStarted","Data":"2d31b7098b763c9cf68a8468d4ac391442902fbd855559e1438b6c13e7fd267b"} Jun 07 16:47:36.709373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:36.708912 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" event={"ID":"40cbc63f-ce22-4c16-95fd-0df42c5f475e","Type":"ContainerStarted","Data":"39f56bd5f18187b00f5554cc4a650cb7c361cbca86a06900bbb53fa8115158cc"} Jun 07 16:47:36.709373 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:36.709060 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:36.725629 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:36.725559 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" podStartSLOduration=1.7255367069999998 podStartE2EDuration="1.725536707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:47:36.722968572 +0000 UTC m=+1215.711859347" watchObservedRunningTime="2026-06-07 16:47:36.725536707 +0000 UTC m=+1215.714427460" Jun 07 16:47:37.381293 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:37.381262 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5hhm_1d9f052d-7795-4e0a-8612-3dc9c772605a/dns/0.log" Jun 07 16:47:37.405163 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:37.405136 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5hhm_1d9f052d-7795-4e0a-8612-3dc9c772605a/kube-rbac-proxy/0.log" Jun 07 16:47:37.546661 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:37.546632 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpc55_f2945f93-8b68-4f02-ba8b-eb5c0a68e375/dns-node-resolver/0.log" Jun 07 16:47:38.078523 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:38.078492 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-977c8fc99-xgrrs_3332e915-18fb-4877-8355-281204c1be35/registry/0.log" Jun 07 16:47:38.082941 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:38.082916 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-977c8fc99-xgrrs_3332e915-18fb-4877-8355-281204c1be35/registry/1.log" Jun 07 16:47:38.102508 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:38.102471 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p4v7_943eb10a-03c7-4fc3-a29f-1771d65b346e/node-ca/0.log" Jun 07 16:47:39.190609 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:39.190580 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-ts5kl_2b4089a9-5e2c-40ab-9305-15ad5eb91054/kube-auth-proxy/0.log" Jun 07 16:47:39.313441 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:39.313412 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jhwqt_74f84e19-6dce-4e59-90d2-ae50f72dffd0/payload-processing/0.log" Jun 07 16:47:39.339357 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:39.339333 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f75767cf5-gqgpp_2a5337ba-2832-4e97-8730-5fac0b5cae54/router/0.log" Jun 07 16:47:39.992390 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:39.992365 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ztb8b_8a251d10-e94f-4056-88a1-cc0c794b0278/serve-healthcheck-canary/0.log" Jun 07 16:47:40.485922 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:40.485889 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xlzb2_5c1ac630-e1d5-42bd-8308-33fac4d53a89/insights-operator/0.log" Jun 07 16:47:40.487644 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:40.487612 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xlzb2_5c1ac630-e1d5-42bd-8308-33fac4d53a89/insights-operator/1.log" Jun 07 16:47:40.577256 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:40.577224 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgnm9_4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7/kube-rbac-proxy/0.log" Jun 07 16:47:40.598911 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:40.598877 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgnm9_4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7/exporter/0.log" Jun 07 16:47:40.621620 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:40.621596 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgnm9_4b63e510-4f2c-4aa6-80ea-bbd84f55a5e7/extractor/0.log" Jun 07 16:47:42.726620 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:42.726590 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-r455f" Jun 07 16:47:43.012484 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:43.012413 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5886cdb686-jjh5j_ae3ed8ae-5d92-4a5a-a08d-cdd0499248a7/manager/0.log" Jun 07 16:47:43.275191 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:43.275108 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-sjhx4_05b0554d-a8d9-4199-9eb0-ed28381363d1/manager/0.log" Jun 07 16:47:43.298115 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:43.298084 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-sjhx4_05b0554d-a8d9-4199-9eb0-ed28381363d1/copy-manifests/0.log" Jun 07 16:47:45.028925 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:45.028894 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b9d9f97f8-fgw9x_68e0b19e-1ab0-4c05-a377-21aa81405a0b/manager/0.log" Jun 07 16:47:49.629503 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:49.629465 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-ts5kl_2b4089a9-5e2c-40ab-9305-15ad5eb91054/kube-auth-proxy/0.log" Jun 07 16:47:49.723645 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:49.723619 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jhwqt_74f84e19-6dce-4e59-90d2-ae50f72dffd0/payload-processing/0.log" Jun 07 16:47:49.737119 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:49.737090 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f75767cf5-gqgpp_2a5337ba-2832-4e97-8730-5fac0b5cae54/router/0.log" Jun 07 16:47:50.594915 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:50.594853 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwzjb_99af884d-1829-4d1b-b51c-761b76432a28/kube-storage-version-migrator-operator/0.log" Jun 07 16:47:50.595738 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:50.595708 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-bwzjb_99af884d-1829-4d1b-b51c-761b76432a28/kube-storage-version-migrator-operator/1.log" Jun 07 16:47:50.903686 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:50.903624 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-ts5kl_2b4089a9-5e2c-40ab-9305-15ad5eb91054/kube-auth-proxy/0.log" Jun 07 16:47:50.995894 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:50.995863 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jhwqt_74f84e19-6dce-4e59-90d2-ae50f72dffd0/payload-processing/0.log" Jun 07 16:47:51.010585 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:51.010557 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f75767cf5-gqgpp_2a5337ba-2832-4e97-8730-5fac0b5cae54/router/0.log" Jun 07 16:47:51.956469 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:51.956437 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/kube-multus-additional-cni-plugins/0.log" Jun 07 16:47:51.976471 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:51.976446 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/egress-router-binary-copy/0.log" Jun 07 16:47:52.001029 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.001004 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/cni-plugins/0.log" Jun 07 16:47:52.024618 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.024591 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/bond-cni-plugin/0.log" Jun 07 16:47:52.044527 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.044501 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/routeoverride-cni/0.log" Jun 07 16:47:52.065930 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.065896 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/whereabouts-cni-bincopy/0.log" Jun 07 16:47:52.088389 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.088350 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hstwv_a9ad68bc-9016-4ece-a165-e1788697d5ca/whereabouts-cni/0.log" Jun 07 16:47:52.315345 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.315267 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rbsqc_f1f8e905-a383-4382-8eee-614e403aa014/kube-multus/0.log" Jun 07 16:47:52.385621 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.385594 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7f8s_dd705cc3-6364-405b-9ab7-6e7b18b350f6/network-metrics-daemon/0.log" Jun 07 16:47:52.405739 ip-10-0-140-203 kubenswrapper[2571]: I0607 16:47:52.405704 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7f8s_dd705cc3-6364-405b-9ab7-6e7b18b350f6/kube-rbac-proxy/0.log"