Jun 08 12:58:27.619659 ip-10-0-140-115 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 12:58:27.619674 ip-10-0-140-115 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 12:58:27.619683 ip-10-0-140-115 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 12:58:27.619903 ip-10-0-140-115 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 12:58:37.780874 ip-10-0-140-115 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 12:58:37.780894 ip-10-0-140-115 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 785a32003c8a4d54ae809d66eed70c19 -- Jun 08 13:01:01.138326 ip-10-0-140-115 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:01:01.530142 ip-10-0-140-115 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:01.530142 ip-10-0-140-115 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:01:01.530142 ip-10-0-140-115 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:01.530142 ip-10-0-140-115 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:01:01.530142 ip-10-0-140-115 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:01.531234 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.530152 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:01:01.534637 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534621 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.534637 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534636 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534640 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534644 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534647 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534650 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534653 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534657 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534660 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534663 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534665 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534668 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534672 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534674 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534677 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534680 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534682 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534685 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534687 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534698 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534701 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.534699 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534704 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534707 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534710 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534712 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534715 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534717 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534720 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534722 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534725 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534727 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534730 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534732 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534734 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534737 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534739 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534742 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534744 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534747 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534749 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534751 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.535181 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534754 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534756 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534759 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534762 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534764 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534767 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534769 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534772 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534774 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534777 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534779 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534781 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534784 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534786 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534791 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534793 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534796 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534799 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534801 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534804 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.535658 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534807 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534811 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534814 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534818 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534820 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534823 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534826 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534828 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534831 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534834 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534836 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534839 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534841 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534844 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534846 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534849 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534852 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534856 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534859 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.536150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534862 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534865 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534867 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534870 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534873 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534875 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534878 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534883 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534886 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534890 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534893 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534896 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534899 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534901 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534904 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534907 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534909 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534912 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.536600 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.534915 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.538194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538181 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.538194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538193 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538196 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538199 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538202 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538205 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538208 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538211 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538214 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538217 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538219 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538223 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538225 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538228 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538230 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538233 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538235 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538238 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538240 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538243 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538245 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.538252 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538248 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538250 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538253 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538255 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538258 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538261 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538264 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538266 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538269 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538271 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538273 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538276 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538279 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538281 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538284 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538286 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538289 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538291 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538294 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538296 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.538733 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538299 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538301 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538304 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538306 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538309 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538311 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538313 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538316 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538319 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538321 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538323 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538326 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538328 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538330 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538334 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538336 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538339 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538342 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538344 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.539243 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538348 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538352 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538356 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538360 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538363 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538366 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538369 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538372 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538375 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538378 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538380 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538383 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538385 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538388 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538392 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538395 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538398 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538401 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538404 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.539697 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538407 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538409 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538412 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538414 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538417 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538420 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538423 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538425 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538428 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538432 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538435 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538437 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538440 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538442 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538445 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538447 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538450 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538452 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538455 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538457 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.540165 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538829 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538834 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538837 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538839 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538842 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538845 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538849 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538853 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538856 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538859 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538862 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538865 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538868 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538872 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538874 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538877 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538880 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538883 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538885 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.540673 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538888 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538891 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538894 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538897 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538900 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538902 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538904 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538907 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538911 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538914 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538917 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538920 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538922 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538925 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538928 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538931 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538934 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538936 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538939 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.541150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538941 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538943 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538946 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538948 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538950 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538953 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538956 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538958 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538961 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538963 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538966 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538968 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538970 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538972 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538975 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538978 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538980 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538983 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538985 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538988 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.541692 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538990 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538993 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538996 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.538998 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539000 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539003 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539006 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539009 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539011 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539014 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539016 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539020 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539024 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539026 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539029 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539031 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539033 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539049 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539053 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.542228 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539055 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539058 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539061 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539063 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539065 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539068 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539070 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539073 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539076 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539078 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539081 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539084 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539087 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539089 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539092 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539094 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539097 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539099 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539102 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539105 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.542679 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539108 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539111 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539183 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539190 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539197 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539201 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539206 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539209 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539212 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539216 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539220 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539223 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539227 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539230 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539233 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539236 2573 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539239 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539242 2573 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539245 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539248 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539252 2573 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539255 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539258 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539261 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:01:01.543178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539265 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539268 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539271 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539275 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539278 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539282 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539284 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539287 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539290 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539293 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539297 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539300 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539303 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539306 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539309 2573 flags.go:64] FLAG: --enable-server="true" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539312 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539317 2573 flags.go:64] FLAG: --event-burst="100" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539320 2573 flags.go:64] FLAG: --event-qps="50" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539323 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539326 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539329 2573 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539333 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539336 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539339 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539342 2573 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:01:01.543813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539345 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539348 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539351 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539354 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539357 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539359 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539363 2573 flags.go:64] FLAG: --feature-gates="" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539366 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539369 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539372 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539375 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539378 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539381 2573 flags.go:64] FLAG: --help="false" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539383 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539386 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539389 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539392 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539398 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539401 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539404 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539407 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539409 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539412 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:01:01.544443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539415 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539418 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539421 2573 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539424 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539427 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539430 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539433 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539436 2573 flags.go:64] FLAG: --lock-file="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539439 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539442 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539445 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539450 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539452 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539455 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539457 2573 flags.go:64] FLAG: --logging-format="text" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539460 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539463 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539466 2573 flags.go:64] FLAG: --manifest-url="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539468 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539472 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539475 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539479 2573 flags.go:64] FLAG: --max-pods="110" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539482 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539485 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539488 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:01:01.545068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539491 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539495 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539497 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539500 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539507 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539510 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539513 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539516 2573 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539519 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539523 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539526 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539529 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539532 2573 flags.go:64] FLAG: --port="10250" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539534 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539537 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025e8ab4120ed899a" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539541 2573 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539543 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539547 2573 flags.go:64] FLAG: --register-node="true" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539549 2573 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539553 2573 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539556 2573 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539558 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539561 2573 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539564 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539567 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:01:01.545674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539570 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539573 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539575 2573 flags.go:64] FLAG: --runonce="false" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539578 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539581 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539584 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539587 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539589 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539594 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539597 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539600 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539603 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539605 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539608 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539610 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539613 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539616 2573 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539619 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539624 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539626 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539629 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539633 2573 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539636 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539639 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539642 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:01:01.546302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539644 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539648 2573 flags.go:64] FLAG: --v="2" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539652 2573 flags.go:64] FLAG: --version="false" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539655 2573 flags.go:64] FLAG: --vmodule="" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539659 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.539662 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539769 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539773 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539776 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539779 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539782 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539784 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539787 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539790 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539793 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539798 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539801 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539803 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539805 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539808 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.546901 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539810 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539813 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539815 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539818 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539820 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539823 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539825 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539828 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539830 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539833 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539837 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539839 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539842 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539844 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539846 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539849 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539852 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539854 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539857 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539859 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539861 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.547401 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539864 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539866 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539869 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539873 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539876 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539878 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539883 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539885 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539888 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539891 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539893 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539896 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539898 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539900 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539903 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539907 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539910 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539912 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539915 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.547911 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539918 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539924 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539926 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539929 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539932 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539934 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539937 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539940 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539942 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539945 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539947 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539950 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539952 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539955 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539957 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539960 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539962 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539964 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539967 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539971 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.548380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539975 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539978 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539981 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539984 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539986 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539989 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539991 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539994 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539996 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.539998 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540001 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540003 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540006 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540009 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540012 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540015 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540018 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540021 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540023 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540026 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.548863 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540028 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540031 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540034 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540049 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.540052 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.540674 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547205 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547219 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547236 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547241 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547295 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547300 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547304 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547306 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547310 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.549353 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547312 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547316 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547318 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547321 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547325 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547329 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547332 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547334 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547338 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547341 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547344 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547347 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547349 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547352 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547356 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547359 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547362 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547365 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.549721 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547368 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547371 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547373 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547376 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547379 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547381 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547386 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547389 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547392 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547395 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547398 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547401 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547404 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547406 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547410 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547413 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547415 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547418 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547420 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547423 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.550194 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547425 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547428 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547431 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547433 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547436 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547438 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547441 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547443 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547446 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547448 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547451 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547453 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547456 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547458 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547461 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547464 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547467 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547470 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547473 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547477 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.550663 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547479 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547482 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547484 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547487 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547489 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547492 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547494 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547497 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547500 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547502 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547505 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547507 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547509 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547512 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547514 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547517 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547519 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547523 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547527 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.551210 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547529 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547532 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547535 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547537 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547540 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547543 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547545 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547548 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547550 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547553 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547555 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547558 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547560 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547563 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547566 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547568 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.551665 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547571 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547576 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547686 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547690 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547694 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547696 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547699 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547702 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547706 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547709 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547712 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547715 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547718 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547721 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:01.552060 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547723 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547726 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547729 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547732 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547734 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547737 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547740 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547743 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547745 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547748 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547750 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547753 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547756 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547758 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547761 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547763 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547766 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547769 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547772 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547774 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:01.552417 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547777 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547780 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547783 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547786 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547788 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547791 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547794 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547797 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547799 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547802 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547804 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547807 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547809 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547812 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547814 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547816 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547819 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547821 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547823 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547826 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:01.552904 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547828 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547831 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547833 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547836 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547838 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547841 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547843 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547846 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547848 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547852 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547856 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547859 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547862 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547865 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547868 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547870 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547873 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547876 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547878 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:01.553393 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547882 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547884 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547887 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547890 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547892 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547895 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547898 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547901 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547903 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547906 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547909 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547912 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547914 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547917 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547920 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547922 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547925 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547928 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547930 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547933 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:01.553841 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547935 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547938 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547940 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547943 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547946 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547948 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547950 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:01.547953 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.547957 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.548073 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.551562 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.552990 2573 server.go:1019] "Starting client certificate rotation" Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.553069 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:01.554318 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.553103 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:01.555619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.555606 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:01.556734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.556705 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:01.569466 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.569440 2573 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:01:01.571875 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.571858 2573 log.go:25] "Validated CRI v1 image API" Jun 08 13:01:01.573463 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.573448 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:01:01.575854 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.575836 2573 fs.go:135] Filesystem UUIDs: map[045d12d6-9e79-4c45-99f3-58cc9285fd73:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a0c34466-c0b2-4419-981a-bfe0405c6845:/dev/nvme0n1p4] Jun 08 13:01:01.575907 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.575854 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:01:01.581027 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.580926 2573 manager.go:216] Machine: {Timestamp:2026-06-08 13:01:01.579519071 +0000 UTC m=+0.327569043 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200339 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7229e70e4095b2f2cb3701e89806 SystemUUID:ec2c7229-e70e-4095-b2f2-cb3701e89806 BootID:785a3200-3c8a-4d54-ae80-9d66eed70c19 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:a9:8d:9a:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:a9:8d:9a:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:51:0e:db:e6:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:01:01.581027 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.581026 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:01:01.581129 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.581116 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:01:01.584134 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.584106 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:01:01.584263 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.584136 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:01:01.584862 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.584851 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:01:01.584892 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.584865 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:01:01.584892 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.584873 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:01.586174 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.586155 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:01.587007 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.586998 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:01:01.588351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.588334 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:01.589729 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589717 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:01.589846 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589837 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:01:01.589882 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589868 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:01:01.589882 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589881 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:01:01.589941 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589894 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:01:01.589941 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589904 2573 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:01:01.589941 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.589912 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:01:01.590312 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.590301 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:01.590349 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.590320 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:01.592553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.592530 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:01:01.594005 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.593991 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:01:01.594073 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.594022 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:01:01.595291 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595280 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:01:01.595333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595296 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:01:01.595333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595302 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:01:01.595333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595307 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:01:01.595333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595325 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:01:01.595333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595330 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595338 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595343 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595349 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595355 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595367 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:01:01.595461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.595372 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:01:01.596327 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.596318 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:01:01.596327 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.596327 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:01:01.599688 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.599671 2573 server.go:1268] "Started kubelet" Jun 08 13:01:01.599794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.599744 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:01:01.599850 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.599813 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:01:01.602915 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.602869 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:01:01.603095 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.603074 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:01:01.603296 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.603275 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:01:01.603473 ip-10-0-140-115 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:01:01.604064 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.603447 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:01:01.604064 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.603508 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:01:01.605891 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.605866 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:01:01.607034 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.607010 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:01:01.610996 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.609815 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-115.ec2.internal.18b71ca26dbc27a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-115.ec2.internal,UID:ip-10-0-140-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-115.ec2.internal,},FirstTimestamp:2026-06-08 13:01:01.599647649 +0000 UTC m=+0.347697621,LastTimestamp:2026-06-08 13:01:01.599647649 +0000 UTC m=+0.347697621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-115.ec2.internal,}" Jun 08 13:01:01.612871 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.612855 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:01:01.612933 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.612867 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:01.613030 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.613008 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:01.613451 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.613436 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:01:01.613451 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.613442 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:01:01.613451 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.613453 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:01:01.613617 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.613572 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:01:01.613617 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.613580 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:01:01.614389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614372 2573 factory.go:153] Registering CRI-O factory Jun 08 13:01:01.614389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614390 2573 factory.go:223] Registration of the crio container factory successfully Jun 08 13:01:01.614515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614430 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:01:01.614515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614437 2573 factory.go:55] Registering systemd factory Jun 08 13:01:01.614515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614442 2573 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:01:01.614515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614465 2573 factory.go:103] Registering Raw factory Jun 08 13:01:01.614515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614477 2573 manager.go:1196] Started watching for new ooms in manager Jun 08 13:01:01.614998 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.614985 2573 manager.go:349] Starting recovery of all containers Jun 08 13:01:01.624585 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.624373 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:01:01.624585 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.624382 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:01:01.624754 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.624740 2573 manager.go:354] Recovery completed Jun 08 13:01:01.628889 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.628877 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.631512 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.631495 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.631573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.631527 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.631573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.631539 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.632198 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.632186 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:01:01.632198 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.632197 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:01:01.632326 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.632216 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:01.632326 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.632259 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.633101 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633082 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.633190 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633119 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.633190 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633148 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.633592 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633579 2573 policy_none.go:49] "None policy: Start" Jun 08 13:01:01.633648 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633606 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:01:01.633648 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.633621 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:01:01.634611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.634597 2573 policy_none.go:47] "Start" Jun 08 13:01:01.636437 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.636420 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lr98s" Jun 08 13:01:01.642184 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.642118 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-115.ec2.internal.18b71ca26fa25caa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-115.ec2.internal,UID:ip-10-0-140-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-115.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-115.ec2.internal,},FirstTimestamp:2026-06-08 13:01:01.631511722 +0000 UTC m=+0.379561695,LastTimestamp:2026-06-08 13:01:01.631511722 +0000 UTC m=+0.379561695,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-115.ec2.internal,}" Jun 08 13:01:01.644998 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.644981 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lr98s" Jun 08 13:01:01.673642 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.673628 2573 manager.go:337] "Starting Device Plugin manager" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.673661 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.673673 2573 server.go:87] "Starting device plugin registration server" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.673918 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.673930 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.674017 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.674116 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.674126 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.674643 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.674688 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.687391 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.688517 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.688548 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.688568 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:01:01.689399 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.688597 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:01:01.690783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.690766 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:01.775076 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.775057 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.777871 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.777845 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.777972 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.777878 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.777972 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.777887 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.777972 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.777910 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.788593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.788540 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.788593 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.788566 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-115.ec2.internal\": node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:01.788703 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.788692 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal"] Jun 08 13:01:01.788786 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.788776 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.790168 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.790153 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.790234 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.790179 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.790234 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.790189 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.791579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.791565 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.791668 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.791654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.791730 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.791689 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.792273 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792254 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.792381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792282 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.792381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792297 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.792381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792340 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.792381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792361 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.792381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.792379 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.793566 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.793547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.793643 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.793581 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:01.794284 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.794269 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:01.794350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.794293 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:01.794350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.794308 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:01.817558 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.817537 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-115.ec2.internal\" not found" node="ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.821784 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.821766 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-115.ec2.internal\" not found" node="ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.824603 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.824586 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:01.914423 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.914391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.914423 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.914425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5eb004ba21b3349901d891de0befaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-115.ec2.internal\" (UID: \"e5eb004ba21b3349901d891de0befaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.914622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:01.914478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:01.925319 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:01.925297 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.015482 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5eb004ba21b3349901d891de0befaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-115.ec2.internal\" (UID: \"e5eb004ba21b3349901d891de0befaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.015482 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.015706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.015706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015542 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.015706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015565 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c10a288608adbacf2abded60662086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal\" (UID: \"37c10a288608adbacf2abded60662086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.015706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.015563 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5eb004ba21b3349901d891de0befaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-115.ec2.internal\" (UID: \"e5eb004ba21b3349901d891de0befaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.025543 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.025513 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.122331 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.122270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.126009 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.125847 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.126009 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.125899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.226902 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.226866 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.327361 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.327330 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.427904 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.427822 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.528363 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.528323 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-115.ec2.internal\" not found" Jun 08 13:01:02.552502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.552475 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:01:02.553071 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.552611 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 13:01:02.580681 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.580658 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:02.591103 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.591083 2573 apiserver.go:52] "Watching apiserver" Jun 08 13:01:02.600530 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.600506 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:01:02.601355 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.601337 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hhppx","kube-system/konnectivity-agent-d6q9d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg","openshift-cluster-node-tuning-operator/tuned-dpq7b","openshift-dns/node-resolver-9nwrs","openshift-multus/multus-additional-cni-plugins-x8n7j","openshift-multus/network-metrics-daemon-fd449","openshift-network-operator/iptables-alerter-c68mj","openshift-image-registry/node-ca-wxv7x","openshift-multus/multus-24ddp","openshift-network-diagnostics/network-check-target-k8nf7","openshift-ovn-kubernetes/ovnkube-node-l478c"] Jun 08 13:01:02.602716 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.602693 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.603736 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.603714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.604757 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.604738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.605733 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.605690 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:01:02.605811 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.605798 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjcmf\"" Jun 08 13:01:02.606008 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.605990 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.606161 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.606144 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.607119 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.606499 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.607119 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.606639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.607302 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.607265 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.607492 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.607474 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.607834 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.607814 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.607947 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.607871 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x4f6\"" Jun 08 13:01:02.608025 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.607815 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nfl2d\"" Jun 08 13:01:02.608554 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.608440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.608654 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.608540 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:02.609838 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.609823 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:01:02.610078 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610058 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:01:02.610193 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610085 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.610193 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610061 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.610193 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610169 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:01:02.610193 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610166 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-99px5\"" Jun 08 13:01:02.610375 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.610178 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.611402 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.611385 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.612657 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.612643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.612938 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.612927 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:02.613353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.613342 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.613791 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.613780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:02.613840 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.613825 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:02.614031 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.614153 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614136 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-497wg\"" Jun 08 13:01:02.614230 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614218 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:01:02.614400 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614384 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:01:02.614457 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614426 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.614625 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614613 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.614694 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614681 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.614728 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-czqpr\"" Jun 08 13:01:02.614946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614929 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:01:02.615025 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.614984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jbmvx\"" Jun 08 13:01:02.615112 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.615089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.615159 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.615139 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:02.616285 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.616261 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.617641 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.617624 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.618273 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-k8s-cni-cncf-io\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-conf-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618304 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-device-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.618368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-sys-fs\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rq7\" (UniqueName: \"kubernetes.io/projected/9e1a4991-f8b9-426c-8d3a-e628e0f84084-kube-api-access-r5rq7\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272jv\" (UniqueName: \"kubernetes.io/projected/0a062ef4-320b-4085-a1ca-405738285104-kube-api-access-272jv\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-tuned\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjhkd\" (UniqueName: \"kubernetes.io/projected/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-kube-api-access-fjhkd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/1cf764e3-72be-4a6b-ad64-af7ce6c84136-kube-api-access-nj66b\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhqq\" (UniqueName: \"kubernetes.io/projected/62bac6eb-61d6-444d-9df3-0107e1baa7f6-kube-api-access-6lhqq\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkpj\" (UniqueName: \"kubernetes.io/projected/2aa34c33-ac0f-4099-b551-c1919a299196-kube-api-access-dfkpj\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.618500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618493 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-kubelet\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2hcg\" (UniqueName: \"kubernetes.io/projected/25079be3-517a-40e3-a824-891f5faee684-kube-api-access-x2hcg\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-run\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618587 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-lib-modules\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-hostroot\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-daemon-config\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1a4991-f8b9-426c-8d3a-e628e0f84084-tmp-dir\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618715 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkrht\"" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618760 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:01:02.618777 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-host\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-conf\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-tmp\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-dbus\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-registration-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cnibin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-os-release\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.618992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-systemd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-var-lib-kubelet\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-netns\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-etc-kubernetes\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-kubelet-config\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.619270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-cnibin\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619212 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-modprobe-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa34c33-ac0f-4099-b551-c1919a299196-host-slash\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca3339d3-e2a1-4cce-ba40-38936b775d80-serviceca\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e1a4991-f8b9-426c-8d3a-e628e0f84084-hosts-file\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbpn4\" (UniqueName: \"kubernetes.io/projected/ca3339d3-e2a1-4cce-ba40-38936b775d80-kube-api-access-tbpn4\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619370 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-kubernetes\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-multus\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619459 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-multus-certs\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-system-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-system-cni-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-socket-dir-parent\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-bin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.619906 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-sys\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aa34c33-ac0f-4099-b551-c1919a299196-iptables-alerter-script\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-os-release\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cni-binary-copy\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-socket-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysconfig\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.620396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.619860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca3339d3-e2a1-4cce-ba40-38936b775d80-host\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.620626 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.620489 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9fhl7\"" Jun 08 13:01:02.620626 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.620545 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:01:02.620739 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.620725 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:01:02.620825 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.620811 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:01:02.620950 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.620936 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:01:02.621171 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.621153 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:01:02.621240 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.621213 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:01:02.629237 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.629220 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:02.631202 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.631187 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:02.631279 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.631250 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" Jun 08 13:01:02.631853 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.631840 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal"] Jun 08 13:01:02.646333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.646312 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal"] Jun 08 13:01:02.646530 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.646510 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:02.647640 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.647584 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:56:01 +0000 UTC" deadline="2027-12-18 19:59:02.906690448 +0000 UTC" Jun 08 13:01:02.647729 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.647641 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13398h58m0.259054173s" Jun 08 13:01:02.664082 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.664063 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v64lr" Jun 08 13:01:02.680675 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.680635 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v64lr" Jun 08 13:01:02.714542 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.714521 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:01:02.720965 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.720946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.720975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-kubelet\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.720992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:02.721065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-kubelet\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2hcg\" (UniqueName: \"kubernetes.io/projected/25079be3-517a-40e3-a824-891f5faee684-kube-api-access-x2hcg\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.721065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-run\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-lib-modules\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-systemd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-kubelet\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721124 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-var-lib-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-config\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-run\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-hostroot\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-daemon-config\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721226 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-lib-modules\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721236 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-hostroot\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1a4991-f8b9-426c-8d3a-e628e0f84084-tmp-dir\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.721367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-host\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-conf\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-host\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-tmp\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-netns\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-dbus\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-conf\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-dbus\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.721597 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-registration-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-bin\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e1a4991-f8b9-426c-8d3a-e628e0f84084-tmp-dir\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.721707 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:03.221684426 +0000 UTC m=+1.969734403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-registration-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.721954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721788 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cnibin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-os-release\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721881 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cnibin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-binary-copy\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-systemd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721924 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-os-release\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-var-lib-kubelet\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-daemon-config\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.721993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-systemd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722026 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a622002f-abba-4298-b114-cb59089c429b-konnectivity-ca\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysctl-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-node-log\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-var-lib-kubelet\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-netns\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.722734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-etc-kubernetes\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-netns\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722174 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-etc-kubernetes\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-kubelet-config\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3cee424-9928-41d2-96b6-67023771461a-kubelet-config\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-cnibin\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-modprobe-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa34c33-ac0f-4099-b551-c1919a299196-host-slash\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca3339d3-e2a1-4cce-ba40-38936b775d80-serviceca\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-cnibin\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e1a4991-f8b9-426c-8d3a-e628e0f84084-hosts-file\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbpn4\" (UniqueName: \"kubernetes.io/projected/ca3339d3-e2a1-4cce-ba40-38936b775d80-kube-api-access-tbpn4\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa34c33-ac0f-4099-b551-c1919a299196-host-slash\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-modprobe-d\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.723511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-etc-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e1a4991-f8b9-426c-8d3a-e628e0f84084-hosts-file\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-netd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-env-overrides\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722496 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-kubernetes\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44gb9\" (UniqueName: \"kubernetes.io/projected/cec7fa88-0ece-40f9-b479-feacdff10870-kube-api-access-44gb9\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-multus\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.722596 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-multus-certs\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722625 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.722645 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:03.222630827 +0000 UTC m=+1.970680804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-systemd-units\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-multus-certs\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-kubernetes\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.724322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-log-socket\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-multus\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cec7fa88-0ece-40f9-b479-feacdff10870-ovn-node-metrics-cert\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-system-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-system-cni-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722807 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca3339d3-e2a1-4cce-ba40-38936b775d80-serviceca\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a622002f-abba-4298-b114-cb59089c429b-agent-certs\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-ovn\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-system-cni-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a062ef4-320b-4085-a1ca-405738285104-system-cni-dir\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-script-lib\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-socket-dir-parent\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-bin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.722995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-socket-dir-parent\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-sys\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.725183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aa34c33-ac0f-4099-b551-c1919a299196-iptables-alerter-script\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-slash\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a062ef4-320b-4085-a1ca-405738285104-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-sys\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-os-release\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cni-binary-copy\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-os-release\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-var-lib-cni-bin\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-socket-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysconfig\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca3339d3-e2a1-4cce-ba40-38936b775d80-host\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-sysconfig\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723736 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca3339d3-e2a1-4cce-ba40-38936b775d80-host\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-k8s-cni-cncf-io\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-conf-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-device-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.725978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-socket-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-host-run-k8s-cni-cncf-io\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf764e3-72be-4a6b-ad64-af7ce6c84136-multus-conf-dir\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-sys-fs\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-sys-fs\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rq7\" (UniqueName: \"kubernetes.io/projected/9e1a4991-f8b9-426c-8d3a-e628e0f84084-kube-api-access-r5rq7\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272jv\" (UniqueName: \"kubernetes.io/projected/0a062ef4-320b-4085-a1ca-405738285104-kube-api-access-272jv\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723974 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25079be3-517a-40e3-a824-891f5faee684-device-dir\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.723985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-tuned\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724008 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjhkd\" (UniqueName: \"kubernetes.io/projected/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-kube-api-access-fjhkd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/1cf764e3-72be-4a6b-ad64-af7ce6c84136-kube-api-access-nj66b\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf764e3-72be-4a6b-ad64-af7ce6c84136-cni-binary-copy\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2aa34c33-ac0f-4099-b551-c1919a299196-iptables-alerter-script\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhqq\" (UniqueName: \"kubernetes.io/projected/62bac6eb-61d6-444d-9df3-0107e1baa7f6-kube-api-access-6lhqq\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.724100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkpj\" (UniqueName: \"kubernetes.io/projected/2aa34c33-ac0f-4099-b551-c1919a299196-kube-api-access-dfkpj\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.725141 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-tmp\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.726622 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.726271 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-etc-tuned\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.732719 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.732701 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:02.732719 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.732722 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:02.732894 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.732735 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:02.732894 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:02.732776 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:03.232763652 +0000 UTC m=+1.980813612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:02.735168 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.735147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2hcg\" (UniqueName: \"kubernetes.io/projected/25079be3-517a-40e3-a824-891f5faee684-kube-api-access-x2hcg\") pod \"aws-ebs-csi-driver-node-mgxzg\" (UID: \"25079be3-517a-40e3-a824-891f5faee684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.735241 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.735210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbpn4\" (UniqueName: \"kubernetes.io/projected/ca3339d3-e2a1-4cce-ba40-38936b775d80-kube-api-access-tbpn4\") pod \"node-ca-wxv7x\" (UID: \"ca3339d3-e2a1-4cce-ba40-38936b775d80\") " pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:02.736368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.736346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhqq\" (UniqueName: \"kubernetes.io/projected/62bac6eb-61d6-444d-9df3-0107e1baa7f6-kube-api-access-6lhqq\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:02.739093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.739069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj66b\" (UniqueName: \"kubernetes.io/projected/1cf764e3-72be-4a6b-ad64-af7ce6c84136-kube-api-access-nj66b\") pod \"multus-24ddp\" (UID: \"1cf764e3-72be-4a6b-ad64-af7ce6c84136\") " pod="openshift-multus/multus-24ddp" Jun 08 13:01:02.739523 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.739500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkpj\" (UniqueName: \"kubernetes.io/projected/2aa34c33-ac0f-4099-b551-c1919a299196-kube-api-access-dfkpj\") pod \"iptables-alerter-c68mj\" (UID: \"2aa34c33-ac0f-4099-b551-c1919a299196\") " pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.740012 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.739986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rq7\" (UniqueName: \"kubernetes.io/projected/9e1a4991-f8b9-426c-8d3a-e628e0f84084-kube-api-access-r5rq7\") pod \"node-resolver-9nwrs\" (UID: \"9e1a4991-f8b9-426c-8d3a-e628e0f84084\") " pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.740095 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.740062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-272jv\" (UniqueName: \"kubernetes.io/projected/0a062ef4-320b-4085-a1ca-405738285104-kube-api-access-272jv\") pod \"multus-additional-cni-plugins-x8n7j\" (UID: \"0a062ef4-320b-4085-a1ca-405738285104\") " pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.740607 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.740592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjhkd\" (UniqueName: \"kubernetes.io/projected/d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265-kube-api-access-fjhkd\") pod \"tuned-dpq7b\" (UID: \"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265\") " pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.773713 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.773688 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:02.824892 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-netns\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.824892 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-bin\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a622002f-abba-4298-b114-cb59089c429b-konnectivity-ca\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-node-log\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-etc-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.824985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-netns\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825004 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-node-log\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-netd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825067 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-netd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-env-overrides\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-etc-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44gb9\" (UniqueName: \"kubernetes.io/projected/cec7fa88-0ece-40f9-b479-feacdff10870-kube-api-access-44gb9\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-systemd-units\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-cni-bin\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-log-socket\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cec7fa88-0ece-40f9-b479-feacdff10870-ovn-node-metrics-cert\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-systemd-units\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-log-socket\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a622002f-abba-4298-b114-cb59089c429b-agent-certs\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-ovn\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-script-lib\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-slash\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a622002f-abba-4298-b114-cb59089c429b-konnectivity-ca\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-kubelet\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-systemd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-var-lib-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-config\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.825828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-env-overrides\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-slash\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.825629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-run-ovn-kubernetes\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-ovn\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-run-systemd\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-script-lib\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-host-kubelet\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cec7fa88-0ece-40f9-b479-feacdff10870-ovnkube-config\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.826653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.826637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cec7fa88-0ece-40f9-b479-feacdff10870-var-lib-openvswitch\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.827793 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.827774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cec7fa88-0ece-40f9-b479-feacdff10870-ovn-node-metrics-cert\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.828185 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.828169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a622002f-abba-4298-b114-cb59089c429b-agent-certs\") pod \"konnectivity-agent-d6q9d\" (UID: \"a622002f-abba-4298-b114-cb59089c429b\") " pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:02.833870 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.833851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44gb9\" (UniqueName: \"kubernetes.io/projected/cec7fa88-0ece-40f9-b479-feacdff10870-kube-api-access-44gb9\") pod \"ovnkube-node-l478c\" (UID: \"cec7fa88-0ece-40f9-b479-feacdff10870\") " pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.840227 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.840187 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5eb004ba21b3349901d891de0befaa4.slice/crio-5c0fa17c1c32a8b3d6cb05ab7f338338e8433f16bdf14bb1cbb94e9ca970219b WatchSource:0}: Error finding container 5c0fa17c1c32a8b3d6cb05ab7f338338e8433f16bdf14bb1cbb94e9ca970219b: Status 404 returned error can't find the container with id 5c0fa17c1c32a8b3d6cb05ab7f338338e8433f16bdf14bb1cbb94e9ca970219b Jun 08 13:01:02.840488 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.840471 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c10a288608adbacf2abded60662086.slice/crio-19846c09ae7e4150adc5790fbb151ee08549936e82165436bc66feb4b80495f5 WatchSource:0}: Error finding container 19846c09ae7e4150adc5790fbb151ee08549936e82165436bc66feb4b80495f5: Status 404 returned error can't find the container with id 19846c09ae7e4150adc5790fbb151ee08549936e82165436bc66feb4b80495f5 Jun 08 13:01:02.845001 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.844983 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:01:02.926803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.926764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" Jun 08 13:01:02.937333 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.937313 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25079be3_517a_40e3_a824_891f5faee684.slice/crio-d85994bf02137d35c4e0b8d2180032c30c21c460b63ee3648d865afa56cb98bb WatchSource:0}: Error finding container d85994bf02137d35c4e0b8d2180032c30c21c460b63ee3648d865afa56cb98bb: Status 404 returned error can't find the container with id d85994bf02137d35c4e0b8d2180032c30c21c460b63ee3648d865afa56cb98bb Jun 08 13:01:02.954326 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.954307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:02.961976 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.961958 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" Jun 08 13:01:02.962373 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.962348 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec7fa88_0ece_40f9_b479_feacdff10870.slice/crio-e496b6d039b357b981875d4e563b862b30a4d33830289bd2c9de7c1712634fef WatchSource:0}: Error finding container e496b6d039b357b981875d4e563b862b30a4d33830289bd2c9de7c1712634fef: Status 404 returned error can't find the container with id e496b6d039b357b981875d4e563b862b30a4d33830289bd2c9de7c1712634fef Jun 08 13:01:02.969133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.969101 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nwrs" Jun 08 13:01:02.970943 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.970924 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c9eb21_17a6_4f3f_ad8b_bc085fd7f265.slice/crio-b56f0d545164304b1bf9f794381592a77da44407e399f25e490bab5d7b486dcd WatchSource:0}: Error finding container b56f0d545164304b1bf9f794381592a77da44407e399f25e490bab5d7b486dcd: Status 404 returned error can't find the container with id b56f0d545164304b1bf9f794381592a77da44407e399f25e490bab5d7b486dcd Jun 08 13:01:02.977056 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.977022 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1a4991_f8b9_426c_8d3a_e628e0f84084.slice/crio-6357ae8aa60e461bd8b959bbb1501c111e0329df8b3e9d45b3542834f1aeeb3e WatchSource:0}: Error finding container 6357ae8aa60e461bd8b959bbb1501c111e0329df8b3e9d45b3542834f1aeeb3e: Status 404 returned error can't find the container with id 6357ae8aa60e461bd8b959bbb1501c111e0329df8b3e9d45b3542834f1aeeb3e Jun 08 13:01:02.989239 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.989220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" Jun 08 13:01:02.994707 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.994690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c68mj" Jun 08 13:01:02.997884 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:02.997864 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a062ef4_320b_4085_a1ca_405738285104.slice/crio-f475c38720e418eeaa5e94342c91eaba216a64a0477b7b1555f95b6cbf874681 WatchSource:0}: Error finding container f475c38720e418eeaa5e94342c91eaba216a64a0477b7b1555f95b6cbf874681: Status 404 returned error can't find the container with id f475c38720e418eeaa5e94342c91eaba216a64a0477b7b1555f95b6cbf874681 Jun 08 13:01:02.999534 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:02.999507 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:03.002130 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:03.002111 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa34c33_ac0f_4099_b551_c1919a299196.slice/crio-e0df0eb49844dac3cc67496b9dae6d0372fc18bd7a2246929d96f8c38b96d232 WatchSource:0}: Error finding container e0df0eb49844dac3cc67496b9dae6d0372fc18bd7a2246929d96f8c38b96d232: Status 404 returned error can't find the container with id e0df0eb49844dac3cc67496b9dae6d0372fc18bd7a2246929d96f8c38b96d232 Jun 08 13:01:03.026865 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.026842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxv7x" Jun 08 13:01:03.034368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.034352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24ddp" Jun 08 13:01:03.034949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.034937 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:03.035240 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:03.035217 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3339d3_e2a1_4cce_ba40_38936b775d80.slice/crio-cc5bd797600313dc7f57a2c87c7eb06e4cb01633ef7290705ea06c35691c85b7 WatchSource:0}: Error finding container cc5bd797600313dc7f57a2c87c7eb06e4cb01633ef7290705ea06c35691c85b7: Status 404 returned error can't find the container with id cc5bd797600313dc7f57a2c87c7eb06e4cb01633ef7290705ea06c35691c85b7 Jun 08 13:01:03.042763 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:03.042743 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf764e3_72be_4a6b_ad64_af7ce6c84136.slice/crio-802d5bf0226698a743eab97278803e44142ca04166732b3b1f4fe40e84693927 WatchSource:0}: Error finding container 802d5bf0226698a743eab97278803e44142ca04166732b3b1f4fe40e84693927: Status 404 returned error can't find the container with id 802d5bf0226698a743eab97278803e44142ca04166732b3b1f4fe40e84693927 Jun 08 13:01:03.047522 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:03.047487 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda622002f_abba_4298_b114_cb59089c429b.slice/crio-68262dc750269a18524dfe08b15243f8b85528f5e229df8a8a76d06d1f64504e WatchSource:0}: Error finding container 68262dc750269a18524dfe08b15243f8b85528f5e229df8a8a76d06d1f64504e: Status 404 returned error can't find the container with id 68262dc750269a18524dfe08b15243f8b85528f5e229df8a8a76d06d1f64504e Jun 08 13:01:03.229108 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.229017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:03.229108 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.229089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:03.229311 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.229149 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:03.229311 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.229200 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:03.229311 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.229215 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:04.22919974 +0000 UTC m=+2.977249700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:03.229311 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.229247 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:04.22923264 +0000 UTC m=+2.977282602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:03.329893 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.329859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:03.330059 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.330027 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:03.330128 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.330063 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:03.330128 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.330074 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:03.330128 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:03.330123 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:04.330110296 +0000 UTC m=+3.078160256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:03.684850 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.684731 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:02 +0000 UTC" deadline="2027-12-06 04:07:28.306793637 +0000 UTC" Jun 08 13:01:03.684850 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.684799 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13095h6m24.621998224s" Jun 08 13:01:03.722203 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.721996 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:03.731363 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.731304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6q9d" event={"ID":"a622002f-abba-4298-b114-cb59089c429b","Type":"ContainerStarted","Data":"68262dc750269a18524dfe08b15243f8b85528f5e229df8a8a76d06d1f64504e"} Jun 08 13:01:03.736815 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.736768 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24ddp" event={"ID":"1cf764e3-72be-4a6b-ad64-af7ce6c84136","Type":"ContainerStarted","Data":"802d5bf0226698a743eab97278803e44142ca04166732b3b1f4fe40e84693927"} Jun 08 13:01:03.749895 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.749824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxv7x" event={"ID":"ca3339d3-e2a1-4cce-ba40-38936b775d80","Type":"ContainerStarted","Data":"cc5bd797600313dc7f57a2c87c7eb06e4cb01633ef7290705ea06c35691c85b7"} Jun 08 13:01:03.780354 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.780320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c68mj" event={"ID":"2aa34c33-ac0f-4099-b551-c1919a299196","Type":"ContainerStarted","Data":"e0df0eb49844dac3cc67496b9dae6d0372fc18bd7a2246929d96f8c38b96d232"} Jun 08 13:01:03.821114 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.821075 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerStarted","Data":"f475c38720e418eeaa5e94342c91eaba216a64a0477b7b1555f95b6cbf874681"} Jun 08 13:01:03.829579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.829545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nwrs" event={"ID":"9e1a4991-f8b9-426c-8d3a-e628e0f84084","Type":"ContainerStarted","Data":"6357ae8aa60e461bd8b959bbb1501c111e0329df8b3e9d45b3542834f1aeeb3e"} Jun 08 13:01:03.839993 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.839963 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" event={"ID":"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265","Type":"ContainerStarted","Data":"b56f0d545164304b1bf9f794381592a77da44407e399f25e490bab5d7b486dcd"} Jun 08 13:01:03.856739 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.856705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"e496b6d039b357b981875d4e563b862b30a4d33830289bd2c9de7c1712634fef"} Jun 08 13:01:03.868054 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.863415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" event={"ID":"25079be3-517a-40e3-a824-891f5faee684","Type":"ContainerStarted","Data":"d85994bf02137d35c4e0b8d2180032c30c21c460b63ee3648d865afa56cb98bb"} Jun 08 13:01:03.892292 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.892259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" event={"ID":"e5eb004ba21b3349901d891de0befaa4","Type":"ContainerStarted","Data":"5c0fa17c1c32a8b3d6cb05ab7f338338e8433f16bdf14bb1cbb94e9ca970219b"} Jun 08 13:01:03.913446 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:03.913289 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" event={"ID":"37c10a288608adbacf2abded60662086","Type":"ContainerStarted","Data":"19846c09ae7e4150adc5790fbb151ee08549936e82165436bc66feb4b80495f5"} Jun 08 13:01:04.239244 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.239206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:04.239434 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.239276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:04.239527 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.239492 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:04.239589 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.239558 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:06.239540445 +0000 UTC m=+4.987590409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:04.239976 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.239958 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:04.240087 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.240009 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:06.239993757 +0000 UTC m=+4.988043723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:04.340473 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.340437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:04.340650 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.340633 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:04.340709 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.340655 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:04.340709 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.340668 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:04.340814 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.340723 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:06.340705868 +0000 UTC m=+5.088755833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:04.685208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.685118 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:02 +0000 UTC" deadline="2028-02-12 07:00:22.973739425 +0000 UTC" Jun 08 13:01:04.685208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.685157 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14729h59m18.288586835s" Jun 08 13:01:04.689480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.689453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:04.689609 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.689575 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:04.689975 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.689957 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:04.690097 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.690076 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:04.690161 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:04.690142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:04.690226 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:04.690209 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:06.258890 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.258854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:06.259371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.258943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:06.259371 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.259071 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:06.259371 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.259130 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:10.259112358 +0000 UTC m=+9.007162323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:06.259537 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.259485 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:06.259537 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.259534 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:10.259519745 +0000 UTC m=+9.007569709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:06.359422 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.359390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:06.359595 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.359532 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:06.359595 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.359547 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:06.359595 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.359555 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:06.359742 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.359607 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:10.359588439 +0000 UTC m=+9.107638415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:06.689763 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.689685 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:06.689922 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.689826 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:06.690228 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.690205 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:06.690326 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.690302 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:06.690393 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:06.690344 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:06.690451 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:06.690402 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:08.689636 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:08.689376 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:08.690136 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:08.689407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:08.690136 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:08.689704 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:08.690136 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:08.689786 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:08.690136 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:08.689445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:08.690136 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:08.689859 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:10.295212 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.295181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:10.295606 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.295225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:10.295606 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.295335 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:10.295606 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.295392 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:18.295379869 +0000 UTC m=+17.043429833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:10.295606 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.295335 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:10.295606 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.295459 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:18.295445344 +0000 UTC m=+17.043495308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:10.396166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.396127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:10.396351 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.396316 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:10.396351 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.396345 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:10.396473 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.396359 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:10.396473 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.396427 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:18.396409315 +0000 UTC m=+17.144459283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:10.689191 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.689108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:10.689357 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.689108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:10.689357 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.689252 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:10.689357 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:10.689112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:10.689357 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.689322 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:10.689544 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:10.689364 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:12.689502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:12.689458 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:12.689949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:12.689468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:12.689949 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:12.689610 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:12.689949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:12.689468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:12.689949 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:12.689670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:12.689949 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:12.689744 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:14.689828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:14.689695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:14.689828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:14.689709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:14.690287 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:14.689845 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:14.690287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:14.689717 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:14.690287 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:14.689940 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:14.690287 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:14.690024 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:16.688820 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:16.688782 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:16.689269 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:16.688841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:16.689269 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:16.688919 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:16.689269 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:16.688935 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:16.689269 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:16.689104 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:16.689269 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:16.689199 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:18.360458 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.360413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:18.360932 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.360482 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:18.360932 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.360577 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:18.360932 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.360590 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:18.360932 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.360660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:34.360639034 +0000 UTC m=+33.108689009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:18.360932 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.360681 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:01:34.360671509 +0000 UTC m=+33.108721481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:18.461397 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.461345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:18.461594 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.461516 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:18.461594 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.461541 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:18.461594 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.461551 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:18.461749 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.461612 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:34.461598713 +0000 UTC m=+33.209648678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:18.689220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.689141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:18.689220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.689179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:18.689220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:18.689188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:18.689496 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.689273 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:18.689496 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.689374 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:18.689496 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:18.689472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:20.689567 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:20.689534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:20.690146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:20.689541 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:20.690146 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:20.689639 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:20.690146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:20.689671 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:20.690146 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:20.689787 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:20.690146 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:20.689884 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:22.689567 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:22.689532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:22.689915 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:22.689532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:22.689915 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:22.689676 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:22.689915 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:22.689714 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:22.689915 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:22.689531 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:22.689915 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:22.689789 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:23.961023 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.960691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6q9d" event={"ID":"a622002f-abba-4298-b114-cb59089c429b","Type":"ContainerStarted","Data":"fd90eef965b5bb89659c765a506914268d300405e32888356e334385caa54d27"} Jun 08 13:01:23.962263 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.962237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24ddp" event={"ID":"1cf764e3-72be-4a6b-ad64-af7ce6c84136","Type":"ContainerStarted","Data":"deaa78342fda08489e4907033bdc3e766fc48fe4d7485e642b4c6814afe0f2da"} Jun 08 13:01:23.963655 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.963627 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxv7x" event={"ID":"ca3339d3-e2a1-4cce-ba40-38936b775d80","Type":"ContainerStarted","Data":"5f6edaf3f1a5d577890fde1fd1d98fbcf62fba7f479d3fd6d4bd68e3b0ea750c"} Jun 08 13:01:23.965230 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.965209 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="b98c3cda0e99d1a154e43e49f63376ec2265d40264075b3847c656465b32fca6" exitCode=0 Jun 08 13:01:23.965327 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.965279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"b98c3cda0e99d1a154e43e49f63376ec2265d40264075b3847c656465b32fca6"} Jun 08 13:01:23.966756 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.966736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nwrs" event={"ID":"9e1a4991-f8b9-426c-8d3a-e628e0f84084","Type":"ContainerStarted","Data":"7a1a7907bd48485d1fb2b38bae38df805322b2156ec04ac5055d80359170a130"} Jun 08 13:01:23.968142 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.968119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" event={"ID":"d9c9eb21-17a6-4f3f-ad8b-bc085fd7f265","Type":"ContainerStarted","Data":"51f9fe541cc333bd5dfa09ff42ae605a6d4498c95d2c125815e4cfa8bf532bc3"} Jun 08 13:01:23.970923 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.970835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:01:23.971199 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971181 2573 generic.go:356] "Generic (PLEG): container finished" podID="cec7fa88-0ece-40f9-b479-feacdff10870" containerID="e637d1919846105a442b24dd4276dc9f14cf0c1ec9ba81694d7c8d1cf69b4422" exitCode=1 Jun 08 13:01:23.971259 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"4c747dd9e15e23ad49e723e86092db6095b918113c5111bf2d7263b2e067d820"} Jun 08 13:01:23.971328 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"4165f4077a63e044a7955b0dd3e0204ecb518f344fc54348aa641c8587b0fcee"} Jun 08 13:01:23.971442 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971357 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"172289b0b76955f7abd61498f972ee8f379764e2ecf3cca34ea273414b12b1c0"} Jun 08 13:01:23.971442 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971401 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"d2a25b037cfc838606b0c5687b0aad30b4c763dbebd6c560c5ce71fc16d51341"} Jun 08 13:01:23.971551 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerDied","Data":"e637d1919846105a442b24dd4276dc9f14cf0c1ec9ba81694d7c8d1cf69b4422"} Jun 08 13:01:23.971551 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.971493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"ec99b32e8c0f207d94c3bdb1081b9ac7b551f15226ec3bb61cd5d3ab2dc6c1cf"} Jun 08 13:01:23.972574 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.972556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" event={"ID":"25079be3-517a-40e3-a824-891f5faee684","Type":"ContainerStarted","Data":"07789f26c7783e2c9a57e8d50a0cf9295e2d07c812cb31dcd484eafe7f2d5596"} Jun 08 13:01:23.973857 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.973839 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" event={"ID":"e5eb004ba21b3349901d891de0befaa4","Type":"ContainerStarted","Data":"8088653aaf10cd6c495864093204e525903f8e4fe48be70792964f8fd3046ef4"} Jun 08 13:01:23.975145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.975124 2573 generic.go:356] "Generic (PLEG): container finished" podID="37c10a288608adbacf2abded60662086" containerID="2cd6ceb2647e0b17c99fd030c84f0f70cb009a553df009da0d60421e8e311f32" exitCode=0 Jun 08 13:01:23.975240 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.975152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" event={"ID":"37c10a288608adbacf2abded60662086","Type":"ContainerDied","Data":"2cd6ceb2647e0b17c99fd030c84f0f70cb009a553df009da0d60421e8e311f32"} Jun 08 13:01:23.979244 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:23.979198 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d6q9d" podStartSLOduration=2.239473692 podStartE2EDuration="21.979187002s" totalImagesPullingTime="19.73971331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:23.97844154 +0000 UTC m=+22.726491521" watchObservedRunningTime="2026-06-08 13:01:23.979187002 +0000 UTC m=+22.727236983" Jun 08 13:01:24.019211 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.019149 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-115.ec2.internal" podStartSLOduration=22.019134347 podStartE2EDuration="22.019134347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.018965509 +0000 UTC m=+22.767015490" watchObservedRunningTime="2026-06-08 13:01:24.019134347 +0000 UTC m=+22.767184328" Jun 08 13:01:24.039824 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.039783 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dpq7b" podStartSLOduration=3.200104345 podStartE2EDuration="23.039764946s" totalImagesPullingTime="19.839660601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.039424962 +0000 UTC m=+22.787474945" watchObservedRunningTime="2026-06-08 13:01:24.039764946 +0000 UTC m=+22.787814929" Jun 08 13:01:24.077129 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.077081 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9nwrs" podStartSLOduration=3.246126859 podStartE2EDuration="23.077063254s" totalImagesPullingTime="19.830936395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.057135776 +0000 UTC m=+22.805185758" watchObservedRunningTime="2026-06-08 13:01:24.077063254 +0000 UTC m=+22.825113237" Jun 08 13:01:24.077419 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.077386 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxv7x" podStartSLOduration=3.3255065999999998 podStartE2EDuration="23.077373489s" totalImagesPullingTime="19.751866889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.076777262 +0000 UTC m=+22.824827244" watchObservedRunningTime="2026-06-08 13:01:24.077373489 +0000 UTC m=+22.825423474" Jun 08 13:01:24.101067 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.100964 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-24ddp" podStartSLOduration=3.2811816990000002 podStartE2EDuration="23.100947092s" totalImagesPullingTime="19.819765393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.100123143 +0000 UTC m=+22.848173125" watchObservedRunningTime="2026-06-08 13:01:24.100947092 +0000 UTC m=+22.848997075" Jun 08 13:01:24.689944 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.689860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:24.689944 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.689884 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:24.690444 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:24.689993 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:24.690444 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.690078 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:24.690444 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:24.690168 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:24.690444 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:24.690239 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:24.978846 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.978714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c68mj" event={"ID":"2aa34c33-ac0f-4099-b551-c1919a299196","Type":"ContainerStarted","Data":"3e18d0ae621028112a2a8fdb9b1efa303fc8eec04e0872119851244db1dc3d7a"} Jun 08 13:01:24.980992 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:24.980912 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" event={"ID":"37c10a288608adbacf2abded60662086","Type":"ContainerStarted","Data":"12a3f1b6b9db2ca7ebae62b58d2db0124cf0ec1d10226fed556c4a03cb4e9bf3"} Jun 08 13:01:25.014303 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.014238 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c68mj" podStartSLOduration=4.229316129 podStartE2EDuration="24.014215021s" totalImagesPullingTime="19.784898892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.996299994 +0000 UTC m=+23.744349977" watchObservedRunningTime="2026-06-08 13:01:25.014215021 +0000 UTC m=+23.762265004" Jun 08 13:01:25.014781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.014719 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-115.ec2.internal" podStartSLOduration=23.014703303 podStartE2EDuration="23.014703303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:25.013975241 +0000 UTC m=+23.762025217" watchObservedRunningTime="2026-06-08 13:01:25.014703303 +0000 UTC m=+23.762753287" Jun 08 13:01:25.183907 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.183839 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:01:25.685740 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.685612 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:01:25.183870271Z","UUID":"ab9a0090-4cfe-41fe-a22a-fde3bd597105","Handler":null,"Name":"","Endpoint":""} Jun 08 13:01:25.687273 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.687248 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:01:25.687415 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.687284 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:01:25.987315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.987245 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:01:25.987758 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.987640 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"55f2fa61f1219ef4c539feeb459731f16b6538ceb347106734c5c9fae0d5b716"} Jun 08 13:01:25.990146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:25.990088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" event={"ID":"25079be3-517a-40e3-a824-891f5faee684","Type":"ContainerStarted","Data":"c580758a559e81a0fa252abe8abf4330c10543637a99094eb3bd25ccae784fb5"} Jun 08 13:01:26.689454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:26.689419 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:26.689714 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:26.689529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:26.689714 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:26.689533 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:26.689714 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:26.689551 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:26.689714 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:26.689617 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:26.689872 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:26.689721 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:26.994996 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:26.994914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" event={"ID":"25079be3-517a-40e3-a824-891f5faee684","Type":"ContainerStarted","Data":"25af87996f729440b5be7134cba73da68362965ca6f75aa27b54db2fb6f47775"} Jun 08 13:01:27.019938 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:27.019887 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgxzg" podStartSLOduration=3.7870395180000003 podStartE2EDuration="26.019873811s" totalImagesPullingTime="22.232834293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:27.018419004 +0000 UTC m=+25.766468996" watchObservedRunningTime="2026-06-08 13:01:27.019873811 +0000 UTC m=+25.767923792" Jun 08 13:01:28.174409 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:28.173956 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:28.175002 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:28.174672 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:28.689340 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:28.689312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:28.689340 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:28.689314 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:28.689553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:28.689314 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:28.689553 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:28.689500 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:28.689643 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:28.689559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:28.689643 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:28.689627 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:29.000511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.000429 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="fe707bb2edb08bfd2871d13c65b0666e50672cbfb070855edf9c65d8c9f4720b" exitCode=0 Jun 08 13:01:29.000511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.000506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"fe707bb2edb08bfd2871d13c65b0666e50672cbfb070855edf9c65d8c9f4720b"} Jun 08 13:01:29.006849 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.006828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:01:29.007264 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.007236 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"e7c038aa927fcae625634bc4dd1023f7bab49ecb126d4dab99a3bcf92292abf6"} Jun 08 13:01:29.007503 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.007483 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:29.007779 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.007763 2573 scope.go:117] "RemoveContainer" containerID="e637d1919846105a442b24dd4276dc9f14cf0c1ec9ba81694d7c8d1cf69b4422" Jun 08 13:01:29.008165 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:29.008144 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d6q9d" Jun 08 13:01:30.012209 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.011934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerStarted","Data":"5cbc4d49e69a1effd2d5b08afb34ef0e93333bd367a38b3151c2eea4e5c64d8c"} Jun 08 13:01:30.015812 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.015793 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:01:30.016224 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.016196 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" event={"ID":"cec7fa88-0ece-40f9-b479-feacdff10870","Type":"ContainerStarted","Data":"2314390aaf5a336b1b7a9424cda04d9fb32d93ae48892b37c8b5784064df6155"} Jun 08 13:01:30.016517 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.016504 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:30.016600 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.016571 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:30.016657 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.016621 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:30.034764 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.034740 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:30.034905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.034848 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:01:30.083732 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.083687 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" podStartSLOduration=8.191964809 podStartE2EDuration="28.083669668s" totalImagesPullingTime="19.891704859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:30.082917626 +0000 UTC m=+28.830967607" watchObservedRunningTime="2026-06-08 13:01:30.083669668 +0000 UTC m=+28.831719650" Jun 08 13:01:30.300191 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.300159 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hhppx"] Jun 08 13:01:30.300352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.300292 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:30.300405 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:30.300369 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:30.303386 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.303362 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8nf7"] Jun 08 13:01:30.303517 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.303473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:30.303591 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:30.303569 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:30.303858 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.303835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd449"] Jun 08 13:01:30.303978 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:30.303937 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:30.304033 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:30.304017 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:31.020879 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:31.020850 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="5cbc4d49e69a1effd2d5b08afb34ef0e93333bd367a38b3151c2eea4e5c64d8c" exitCode=0 Jun 08 13:01:31.021311 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:31.020930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"5cbc4d49e69a1effd2d5b08afb34ef0e93333bd367a38b3151c2eea4e5c64d8c"} Jun 08 13:01:31.690685 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:31.690654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:31.690852 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:31.690753 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:31.690852 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:31.690809 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:31.690852 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:31.690829 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:32.688799 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:32.688775 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:32.689221 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:32.688867 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:33.027353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:33.027275 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="782bc7c17ba2373bf8c4f55da5e2ab35c43e032d991ff1b4b829f4093c3bd7c7" exitCode=0 Jun 08 13:01:33.027353 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:33.027327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"782bc7c17ba2373bf8c4f55da5e2ab35c43e032d991ff1b4b829f4093c3bd7c7"} Jun 08 13:01:33.689908 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:33.689818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:33.690338 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:33.689818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:33.690338 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:33.689957 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hhppx" podUID="e3cee424-9928-41d2-96b6-67023771461a" Jun 08 13:01:33.690338 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:33.689991 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k8nf7" podUID="25d09e71-994e-4e10-9db7-d16c99d46ba6" Jun 08 13:01:34.382367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:34.382327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:34.382605 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:34.382386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:34.382605 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.382489 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:34.382605 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.382514 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:34.382605 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.382557 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:06.382543818 +0000 UTC m=+65.130593779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:34.382605 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.382577 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret podName:e3cee424-9928-41d2-96b6-67023771461a nodeName:}" failed. No retries permitted until 2026-06-08 13:02:06.382568205 +0000 UTC m=+65.130618172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret") pod "global-pull-secret-syncer-hhppx" (UID: "e3cee424-9928-41d2-96b6-67023771461a") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:34.483336 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:34.483301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:34.483519 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.483482 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:34.483519 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.483506 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:34.483519 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.483518 2573 projected.go:196] Error preparing data for projected volume kube-api-access-hw7lx for pod openshift-network-diagnostics/network-check-target-k8nf7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:34.483671 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.483575 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx podName:25d09e71-994e-4e10-9db7-d16c99d46ba6 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:06.483560927 +0000 UTC m=+65.231610891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hw7lx" (UniqueName: "kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx") pod "network-check-target-k8nf7" (UID: "25d09e71-994e-4e10-9db7-d16c99d46ba6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:34.689103 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:34.689071 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:34.689274 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:34.689178 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:01:35.124762 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.124688 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-115.ec2.internal" event="NodeReady" Jun 08 13:01:35.125172 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.124840 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:01:35.159974 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.159935 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:01:35.182270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.182235 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2"] Jun 08 13:01:35.182446 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.182344 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.185021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.184972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 13:01:35.185939 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.185913 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2kwt7\"" Jun 08 13:01:35.186190 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.186168 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 13:01:35.186828 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.184973 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 13:01:35.192109 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.192090 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 13:01:35.197692 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.197674 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:01:35.197794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.197711 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gkb5x"] Jun 08 13:01:35.197794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.197784 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.200531 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.200509 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7vtn7\"" Jun 08 13:01:35.200631 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.200573 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 13:01:35.200631 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.200519 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 13:01:35.218382 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.218364 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2rfqd"] Jun 08 13:01:35.218488 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.218475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.221188 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.221174 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:01:35.221276 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.221189 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:01:35.221676 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.221663 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:01:35.221762 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.221745 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b76ln\"" Jun 08 13:01:35.239983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.239952 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2"] Jun 08 13:01:35.239983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.239991 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkb5x"] Jun 08 13:01:35.239983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.240012 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rfqd"] Jun 08 13:01:35.240244 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.240136 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.242903 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.242831 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:01:35.243014 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.242928 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:01:35.243178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.243164 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:01:35.288639 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288655 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.288783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrrc\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9f1f54d-4145-49e1-9f61-3f54b249e108-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.288966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.288966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.288940 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.369000 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.368961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:35.389817 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.389780 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.389980 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.389832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.389980 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.389939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390121 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.389993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390121 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.390012 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:35.390121 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390018 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dmv\" (UniqueName: \"kubernetes.io/projected/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-kube-api-access-59dmv\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.390121 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.390090 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:35.890070839 +0000 UTC m=+34.638120819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjc7\" (UniqueName: \"kubernetes.io/projected/d5dc6374-af77-41d4-80b1-2223bdc90381-kube-api-access-xjjc7\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390157 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrrc\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5dc6374-af77-41d4-80b1-2223bdc90381-tmp-dir\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-cert\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.390330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5dc6374-af77-41d4-80b1-2223bdc90381-config-volume\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9f1f54d-4145-49e1-9f61-3f54b249e108-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.390485 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.390486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.390496 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:35.390653 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.390586 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:35.890570015 +0000 UTC m=+34.638619982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:35.391180 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.391158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.391321 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.391297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9f1f54d-4145-49e1-9f61-3f54b249e108-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.391477 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.391458 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.395443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.395298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.395443 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.395329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.400417 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.400389 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.400612 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.400497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glrrc\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.487403 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.487366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:35.491144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dmv\" (UniqueName: \"kubernetes.io/projected/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-kube-api-access-59dmv\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.491144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491147 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjc7\" (UniqueName: \"kubernetes.io/projected/d5dc6374-af77-41d4-80b1-2223bdc90381-kube-api-access-xjjc7\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.491315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5dc6374-af77-41d4-80b1-2223bdc90381-tmp-dir\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.491315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.491315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-cert\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.491315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5dc6374-af77-41d4-80b1-2223bdc90381-config-volume\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.491491 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.491469 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:35.491530 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5dc6374-af77-41d4-80b1-2223bdc90381-tmp-dir\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.491565 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.491555 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:35.991536282 +0000 UTC m=+34.739586243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:01:35.491789 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.491772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5dc6374-af77-41d4-80b1-2223bdc90381-config-volume\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.493642 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.493623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-cert\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.503905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.503875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dmv\" (UniqueName: \"kubernetes.io/projected/1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321-kube-api-access-59dmv\") pod \"ingress-canary-gkb5x\" (UID: \"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321\") " pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.503905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.503901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjc7\" (UniqueName: \"kubernetes.io/projected/d5dc6374-af77-41d4-80b1-2223bdc90381-kube-api-access-xjjc7\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.527116 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.527092 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkb5x" Jun 08 13:01:35.689482 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.689395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:01:35.689636 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.689584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:01:35.692483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.692335 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:01:35.692483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.692407 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:01:35.692483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.692471 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:01:35.692483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.692407 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:01:35.894800 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.894768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:35.894967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.894851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:35.894967 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.894935 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:35.894967 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.894958 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:35.895195 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.895004 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:35.895195 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.895055 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:36.895013371 +0000 UTC m=+35.643063346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:35.895195 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.895075 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:36.895065862 +0000 UTC m=+35.643115822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:35.995733 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:35.995650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:35.995883 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.995804 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:35.995939 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:35.995881 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:36.995861705 +0000 UTC m=+35.743911667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:01:36.688970 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:36.688939 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:01:36.692156 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:36.692135 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:01:36.692287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:36.692163 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:01:36.903598 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:36.903562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:36.903784 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:36.903632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:36.903784 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:36.903735 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:36.903784 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:36.903757 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:36.903940 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:36.903798 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:36.903940 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:36.903825 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:38.903809766 +0000 UTC m=+37.651859747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:36.903940 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:36.903868 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:38.903851449 +0000 UTC m=+37.651901424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:37.004660 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:37.004624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:37.004793 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:37.004767 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:37.004842 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:37.004832 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.004813723 +0000 UTC m=+37.752863684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:01:37.145480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:37.145450 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkb5x"] Jun 08 13:01:37.221191 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:01:37.221161 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e66a5a2_1298_4f8a_9fa0_9fd32dcdb321.slice/crio-c8dc227ea762ea52b27becbadd237aaef11faa116f76b6e619019c0f6809fb20 WatchSource:0}: Error finding container c8dc227ea762ea52b27becbadd237aaef11faa116f76b6e619019c0f6809fb20: Status 404 returned error can't find the container with id c8dc227ea762ea52b27becbadd237aaef11faa116f76b6e619019c0f6809fb20 Jun 08 13:01:38.039964 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:38.039929 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkb5x" event={"ID":"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321","Type":"ContainerStarted","Data":"c8dc227ea762ea52b27becbadd237aaef11faa116f76b6e619019c0f6809fb20"} Jun 08 13:01:38.042975 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:38.042949 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="d4dc5be18b19f145d3b1f48fa6a1b5e058c1ce4e32ea76795f4d4a40c797cf3e" exitCode=0 Jun 08 13:01:38.043126 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:38.042995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"d4dc5be18b19f145d3b1f48fa6a1b5e058c1ce4e32ea76795f4d4a40c797cf3e"} Jun 08 13:01:38.919558 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:38.919343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:38.919761 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:38.919588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:38.919761 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:38.919513 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:38.919761 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:38.919652 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:38.919761 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:38.919715 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:38.919761 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:38.919720 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:42.919699745 +0000 UTC m=+41.667749710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:38.919976 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:38.919768 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:42.919753729 +0000 UTC m=+41.667803689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:39.020652 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:39.020615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:39.020841 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:39.020791 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:39.020903 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:39.020864 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:43.020846795 +0000 UTC m=+41.768896762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:01:39.048584 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:39.048552 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a062ef4-320b-4085-a1ca-405738285104" containerID="73f17cd07fa4e25976423c2a5ecd54bbf970be5e64d4bb6bf592666214529108" exitCode=0 Jun 08 13:01:39.049026 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:39.048610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerDied","Data":"73f17cd07fa4e25976423c2a5ecd54bbf970be5e64d4bb6bf592666214529108"} Jun 08 13:01:39.995933 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:39.995850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:40.052422 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.052391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkb5x" event={"ID":"1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321","Type":"ContainerStarted","Data":"bda4a841e4d28f466f2548f2dc5a3590b30b05f5c7f4cef0151aa61c73ed5ae6"} Jun 08 13:01:40.055401 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.055377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" event={"ID":"0a062ef4-320b-4085-a1ca-405738285104","Type":"ContainerStarted","Data":"4ea5d8beca13be736ba80ce602773ee13effdc948a258812eae5f858140448db"} Jun 08 13:01:40.059809 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.059787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:40.070149 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.070108 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gkb5x" podStartSLOduration=2.820286594 podStartE2EDuration="5.070095294s" totalImagesPullingTime="2.2498087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:40.069430676 +0000 UTC m=+38.817480655" watchObservedRunningTime="2026-06-08 13:01:40.070095294 +0000 UTC m=+38.818145276" Jun 08 13:01:40.096287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.096245 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x8n7j" podStartSLOduration=8.904398855 podStartE2EDuration="39.096231816s" totalImagesPullingTime="30.191832961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:40.095026894 +0000 UTC m=+38.843076876" watchObservedRunningTime="2026-06-08 13:01:40.096231816 +0000 UTC m=+38.844281797" Jun 08 13:01:40.219187 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.219152 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:40.288996 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.288889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:40.348948 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:40.348916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:41.309176 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:41.309142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:42.954688 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:42.954650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:42.954706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:42.954796 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:42.954814 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:42.954821 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:42.954870 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:50.954856012 +0000 UTC m=+49.702905973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:42.955157 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:42.954885 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:50.9548788 +0000 UTC m=+49.702928760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:43.055512 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:43.055476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:43.055709 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:43.055638 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:43.055769 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:43.055717 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:51.055697647 +0000 UTC m=+49.803747611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:01:43.805663 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:43.805618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:43.906108 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:43.906071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:51.010377 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:51.010337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:51.010398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.010488 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.010496 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.010517 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.010542 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:07.010528126 +0000 UTC m=+65.758578086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:01:51.010823 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.010576 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:07.010561752 +0000 UTC m=+65.758611713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:01:51.111351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:01:51.111313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:01:51.111492 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.111429 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:51.111492 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:01:51.111478 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:07.111465731 +0000 UTC m=+65.859515691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:02:02.033173 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:02.033147 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l478c" Jun 08 13:02:06.427830 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.427776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:02:06.428245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.427870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:02:06.430523 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.430502 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:02:06.430604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.430585 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:02:06.438653 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:06.438631 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:02:06.438714 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:06.438704 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:10.438687257 +0000 UTC m=+129.186737218 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : secret "metrics-daemon-secret" not found Jun 08 13:02:06.441968 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.441949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3cee424-9928-41d2-96b6-67023771461a-original-pull-secret\") pod \"global-pull-secret-syncer-hhppx\" (UID: \"e3cee424-9928-41d2-96b6-67023771461a\") " pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:02:06.528433 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.528396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:02:06.531532 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.531514 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:02:06.541367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.541346 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:02:06.551890 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.551868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw7lx\" (UniqueName: \"kubernetes.io/projected/25d09e71-994e-4e10-9db7-d16c99d46ba6-kube-api-access-hw7lx\") pod \"network-check-target-k8nf7\" (UID: \"25d09e71-994e-4e10-9db7-d16c99d46ba6\") " pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:02:06.603836 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.603808 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:02:06.606993 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.606967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hhppx" Jun 08 13:02:06.611317 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.611299 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:02:06.742456 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.742383 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hhppx"] Jun 08 13:02:06.747057 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:02:06.747016 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cee424_9928_41d2_96b6_67023771461a.slice/crio-83abfe434ad55192c8786ba5330843f60b3931304de1787cce20c0a2da1e40f2 WatchSource:0}: Error finding container 83abfe434ad55192c8786ba5330843f60b3931304de1787cce20c0a2da1e40f2: Status 404 returned error can't find the container with id 83abfe434ad55192c8786ba5330843f60b3931304de1787cce20c0a2da1e40f2 Jun 08 13:02:06.756132 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:06.756107 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k8nf7"] Jun 08 13:02:06.758407 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:02:06.758381 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d09e71_994e_4e10_9db7_d16c99d46ba6.slice/crio-cf3e2cb9dbce5781c23c8e7e8ddaa7b636d7106d01edd2d73faa8047f1901a6f WatchSource:0}: Error finding container cf3e2cb9dbce5781c23c8e7e8ddaa7b636d7106d01edd2d73faa8047f1901a6f: Status 404 returned error can't find the container with id cf3e2cb9dbce5781c23c8e7e8ddaa7b636d7106d01edd2d73faa8047f1901a6f Jun 08 13:02:07.033983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:07.033873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:02:07.033983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:07.033945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:02:07.034197 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.034063 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:02:07.034197 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.034135 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:39.03411896 +0000 UTC m=+97.782168925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:02:07.034197 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.034066 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:02:07.034197 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.034171 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:02:07.034332 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.034223 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:39.034210557 +0000 UTC m=+97.782260517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:02:07.114148 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:07.114102 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8nf7" event={"ID":"25d09e71-994e-4e10-9db7-d16c99d46ba6","Type":"ContainerStarted","Data":"cf3e2cb9dbce5781c23c8e7e8ddaa7b636d7106d01edd2d73faa8047f1901a6f"} Jun 08 13:02:07.115094 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:07.115073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hhppx" event={"ID":"e3cee424-9928-41d2-96b6-67023771461a","Type":"ContainerStarted","Data":"83abfe434ad55192c8786ba5330843f60b3931304de1787cce20c0a2da1e40f2"} Jun 08 13:02:07.134405 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:07.134378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:02:07.134547 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.134528 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:07.134604 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:07.134595 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:39.134581322 +0000 UTC m=+97.882631282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:02:13.132084 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:13.131988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k8nf7" event={"ID":"25d09e71-994e-4e10-9db7-d16c99d46ba6","Type":"ContainerStarted","Data":"7e6c7ace829efef70a2cbbc1b500714c1428ff82362115d5192e6f915ddfc0f5"} Jun 08 13:02:13.132482 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:13.132114 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:02:13.133409 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:13.133384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hhppx" event={"ID":"e3cee424-9928-41d2-96b6-67023771461a","Type":"ContainerStarted","Data":"aa0d4c592eb225ac48fd3bcf808802edf3334c16472f0b068f149cab272488c3"} Jun 08 13:02:13.150803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:13.150758 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k8nf7" podStartSLOduration=66.087769232 podStartE2EDuration="1m12.150744894s" totalImagesPullingTime="6.062975662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:13.148304131 +0000 UTC m=+71.896354112" watchObservedRunningTime="2026-06-08 13:02:13.150744894 +0000 UTC m=+71.898794910" Jun 08 13:02:13.165568 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:13.165512 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hhppx" podStartSLOduration=65.09064297 podStartE2EDuration="1m11.165497455s" totalImagesPullingTime="6.074854485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:13.165399245 +0000 UTC m=+71.913449228" watchObservedRunningTime="2026-06-08 13:02:13.165497455 +0000 UTC m=+71.913547436" Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:39.071615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:39.071748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.071902 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.071917 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.071985 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:43.071967625 +0000 UTC m=+161.820017605 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.072523 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:02:39.074194 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.072580 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:43.072558928 +0000 UTC m=+161.820608895 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:02:39.172666 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:39.172625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:02:39.172836 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.172735 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:39.172836 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:02:39.172794 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:43.172781262 +0000 UTC m=+161.920831222 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:02:44.138543 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:02:44.138514 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k8nf7" Jun 08 13:03:10.501544 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:10.501490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:03:10.502025 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:10.501655 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:03:10.502025 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:10.501728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:12.501712112 +0000 UTC m=+251.249762072 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : secret "metrics-daemon-secret" not found Jun 08 13:03:38.196372 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:38.196326 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" Jun 08 13:03:38.208620 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:38.208588 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" podUID="a9f1f54d-4145-49e1-9f61-3f54b249e108" Jun 08 13:03:38.249830 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:38.249784 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2rfqd" podUID="d5dc6374-af77-41d4-80b1-2223bdc90381" Jun 08 13:03:38.330573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:38.330548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:03:38.330737 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:38.330548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:03:39.699855 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:39.699818 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:03:43.134784 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:43.134735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:43.134801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.134899 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.134958 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert podName:a9f1f54d-4145-49e1-9f61-3f54b249e108 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:45.134945191 +0000 UTC m=+283.882995151 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-m24c2" (UID: "a9f1f54d-4145-49e1-9f61-3f54b249e108") : secret "networking-console-plugin-cert" not found Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.134897 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.134980 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79666c7cd4-zt4sj: secret "image-registry-tls" not found Jun 08 13:03:43.135218 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.135004 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls podName:4afaf409-b874-4541-bfa3-5caf9ffd71f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:45.134997341 +0000 UTC m=+283.883047301 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls") pod "image-registry-79666c7cd4-zt4sj" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0") : secret "image-registry-tls" not found Jun 08 13:03:43.235287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:43.235245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:03:43.235455 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.235365 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:03:43.235455 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:03:43.235423 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls podName:d5dc6374-af77-41d4-80b1-2223bdc90381 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:45.235411087 +0000 UTC m=+283.983461050 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls") pod "dns-default-2rfqd" (UID: "d5dc6374-af77-41d4-80b1-2223bdc90381") : secret "dns-default-metrics-tls" not found Jun 08 13:03:49.689118 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:49.689080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rfqd" Jun 08 13:03:54.688909 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:03:54.688842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:05:12.588870 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:12.588823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:05:12.589401 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:12.588985 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:05:12.589401 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:12.589074 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs podName:62bac6eb-61d6-444d-9df3-0107e1baa7f6 nodeName:}" failed. No retries permitted until 2026-06-08 13:07:14.589056734 +0000 UTC m=+373.337106694 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs") pod "network-metrics-daemon-fd449" (UID: "62bac6eb-61d6-444d-9df3-0107e1baa7f6") : secret "metrics-daemon-secret" not found Jun 08 13:05:17.222190 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.222157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-4xcqm"] Jun 08 13:05:17.223953 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.223937 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.224996 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.224974 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85"] Jun 08 13:05:17.226522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.226507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.233676 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.233654 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 13:05:17.233797 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.233684 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 13:05:17.233797 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.233684 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.234674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.234660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 13:05:17.235450 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.235431 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jkftg"] Jun 08 13:05:17.236295 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.236158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.236687 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.236664 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5zbzz\"" Jun 08 13:05:17.236786 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.236687 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xspjc\"" Jun 08 13:05:17.236786 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.236760 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.236897 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.236840 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 13:05:17.237096 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.237081 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.240263 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.240247 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.241232 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.241217 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.241381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.241366 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 13:05:17.242538 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.242520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 13:05:17.242538 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.242531 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.247717 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.247700 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xh5cb\"" Jun 08 13:05:17.254863 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.254830 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 13:05:17.256459 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.256435 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4xcqm"] Jun 08 13:05:17.257205 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.257185 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jkftg"] Jun 08 13:05:17.263123 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.263106 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 13:05:17.273836 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.273813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85"] Jun 08 13:05:17.316837 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.316807 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q"] Jun 08 13:05:17.318659 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.318644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" Jun 08 13:05:17.320999 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.320973 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86"] Jun 08 13:05:17.322604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-snapshots\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.322694 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-service-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.322694 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-trusted-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.322694 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322656 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg"] Jun 08 13:05:17.322802 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322717 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" Jun 08 13:05:17.322851 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqnk\" (UniqueName: \"kubernetes.io/projected/0ec7a948-9cbb-49b6-b141-fd4fec23853c-kube-api-access-zfqnk\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.322905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.322955 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.322920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44b2k\" (UniqueName: \"kubernetes.io/projected/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-kube-api-access-44b2k\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.323315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-trusted-ca\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.323380 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jzdc\" (UniqueName: \"kubernetes.io/projected/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-kube-api-access-2jzdc\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.323429 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-tmp\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.323429 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323413 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec7a948-9cbb-49b6-b141-fd4fec23853c-serving-cert\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.323533 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-serving-cert\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.323533 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323469 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-config\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.323533 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.323516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.324398 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.324382 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd"] Jun 08 13:05:17.324529 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.324506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.325251 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.325233 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hrlbk\"" Jun 08 13:05:17.326065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.326030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.326253 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.326236 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.326513 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.326496 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9fqdm\"" Jun 08 13:05:17.326598 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.326558 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.329161 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.329142 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 13:05:17.329364 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.329348 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.329460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.329441 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 13:05:17.329638 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.329625 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.332505 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332487 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 13:05:17.332586 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.332586 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332517 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 13:05:17.332697 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332579 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.332867 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332851 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rvngd\"" Jun 08 13:05:17.332867 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.332859 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fzqm8\"" Jun 08 13:05:17.341784 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.341768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q"] Jun 08 13:05:17.342539 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.342523 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg"] Jun 08 13:05:17.345951 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.345903 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86"] Jun 08 13:05:17.363344 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.363322 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd"] Jun 08 13:05:17.424149 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-snapshots\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-service-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-trusted-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6720ced6-58e0-45fc-9f12-332f91ba9cf5-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqnk\" (UniqueName: \"kubernetes.io/projected/0ec7a948-9cbb-49b6-b141-fd4fec23853c-kube-api-access-zfqnk\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af38b37e-d7bd-4491-a242-71cf9d30f483-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.424332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44b2k\" (UniqueName: \"kubernetes.io/projected/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-kube-api-access-44b2k\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7bk\" (UniqueName: \"kubernetes.io/projected/edf3d1ae-5f72-438e-b536-1e0d26db4369-kube-api-access-gf7bk\") pod \"network-check-source-dbd9cf844-5fg6q\" (UID: \"edf3d1ae-5f72-438e-b536-1e0d26db4369\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:17.424408 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:17.424477 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:17.924457761 +0000 UTC m=+256.672507739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-295p8\" (UniqueName: \"kubernetes.io/projected/6720ced6-58e0-45fc-9f12-332f91ba9cf5-kube-api-access-295p8\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af38b37e-d7bd-4491-a242-71cf9d30f483-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-trusted-ca\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.424680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5m9p\" (UniqueName: \"kubernetes.io/projected/0a3378f7-99df-4841-b3ce-148fe5b162f8-kube-api-access-g5m9p\") pod \"volume-data-source-validator-78dd696465-lqs86\" (UID: \"0a3378f7-99df-4841-b3ce-148fe5b162f8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6720ced6-58e0-45fc-9f12-332f91ba9cf5-config\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jzdc\" (UniqueName: \"kubernetes.io/projected/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-kube-api-access-2jzdc\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-tmp\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-snapshots\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec7a948-9cbb-49b6-b141-fd4fec23853c-serving-cert\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-service-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-serving-cert\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-config\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.424994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.424984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2kv\" (UniqueName: \"kubernetes.io/projected/af38b37e-d7bd-4491-a242-71cf9d30f483-kube-api-access-mk2kv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.425497 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.425171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec7a948-9cbb-49b6-b141-fd4fec23853c-tmp\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.425497 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.425215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec7a948-9cbb-49b6-b141-fd4fec23853c-trusted-ca-bundle\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.425497 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.425392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-trusted-ca\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.425651 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.425569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-config\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.425720 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.425698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.427229 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.427205 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec7a948-9cbb-49b6-b141-fd4fec23853c-serving-cert\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.427334 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.427254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-serving-cert\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.439460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.439430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqnk\" (UniqueName: \"kubernetes.io/projected/0ec7a948-9cbb-49b6-b141-fd4fec23853c-kube-api-access-zfqnk\") pod \"insights-operator-896549976-4xcqm\" (UID: \"0ec7a948-9cbb-49b6-b141-fd4fec23853c\") " pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.441287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.441266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jzdc\" (UniqueName: \"kubernetes.io/projected/a4e5afe6-69a8-47a2-ac61-ed7ab109c913-kube-api-access-2jzdc\") pod \"console-operator-668fdbf85c-jkftg\" (UID: \"a4e5afe6-69a8-47a2-ac61-ed7ab109c913\") " pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.441394 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.441365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44b2k\" (UniqueName: \"kubernetes.io/projected/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-kube-api-access-44b2k\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.526293 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5m9p\" (UniqueName: \"kubernetes.io/projected/0a3378f7-99df-4841-b3ce-148fe5b162f8-kube-api-access-g5m9p\") pod \"volume-data-source-validator-78dd696465-lqs86\" (UID: \"0a3378f7-99df-4841-b3ce-148fe5b162f8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" Jun 08 13:05:17.526293 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6720ced6-58e0-45fc-9f12-332f91ba9cf5-config\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.526293 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2kv\" (UniqueName: \"kubernetes.io/projected/af38b37e-d7bd-4491-a242-71cf9d30f483-kube-api-access-mk2kv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.526575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6720ced6-58e0-45fc-9f12-332f91ba9cf5-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.526575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af38b37e-d7bd-4491-a242-71cf9d30f483-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.526575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7bk\" (UniqueName: \"kubernetes.io/projected/edf3d1ae-5f72-438e-b536-1e0d26db4369-kube-api-access-gf7bk\") pod \"network-check-source-dbd9cf844-5fg6q\" (UID: \"edf3d1ae-5f72-438e-b536-1e0d26db4369\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" Jun 08 13:05:17.526575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-295p8\" (UniqueName: \"kubernetes.io/projected/6720ced6-58e0-45fc-9f12-332f91ba9cf5-kube-api-access-295p8\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.526575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af38b37e-d7bd-4491-a242-71cf9d30f483-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.526910 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.526886 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6720ced6-58e0-45fc-9f12-332f91ba9cf5-config\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.527130 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.527112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af38b37e-d7bd-4491-a242-71cf9d30f483-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.528611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.528588 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6720ced6-58e0-45fc-9f12-332f91ba9cf5-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.528724 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.528631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af38b37e-d7bd-4491-a242-71cf9d30f483-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.533625 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.533610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4xcqm" Jun 08 13:05:17.540069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.540019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2kv\" (UniqueName: \"kubernetes.io/projected/af38b37e-d7bd-4491-a242-71cf9d30f483-kube-api-access-mk2kv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-9spjd\" (UID: \"af38b37e-d7bd-4491-a242-71cf9d30f483\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.542128 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.542109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-295p8\" (UniqueName: \"kubernetes.io/projected/6720ced6-58e0-45fc-9f12-332f91ba9cf5-kube-api-access-295p8\") pod \"service-ca-operator-6bc5ff68f5-8lrkg\" (UID: \"6720ced6-58e0-45fc-9f12-332f91ba9cf5\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.542277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.542258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5m9p\" (UniqueName: \"kubernetes.io/projected/0a3378f7-99df-4841-b3ce-148fe5b162f8-kube-api-access-g5m9p\") pod \"volume-data-source-validator-78dd696465-lqs86\" (UID: \"0a3378f7-99df-4841-b3ce-148fe5b162f8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" Jun 08 13:05:17.542593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.542523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7bk\" (UniqueName: \"kubernetes.io/projected/edf3d1ae-5f72-438e-b536-1e0d26db4369-kube-api-access-gf7bk\") pod \"network-check-source-dbd9cf844-5fg6q\" (UID: \"edf3d1ae-5f72-438e-b536-1e0d26db4369\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" Jun 08 13:05:17.545105 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.545087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:17.629579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.629505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" Jun 08 13:05:17.635094 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.635068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" Jun 08 13:05:17.641438 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.641392 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" Jun 08 13:05:17.648170 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.647832 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" Jun 08 13:05:17.672030 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.671920 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4xcqm"] Jun 08 13:05:17.675139 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:17.675107 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec7a948_9cbb_49b6_b141_fd4fec23853c.slice/crio-e778682f5e5a3424a1b773d54bebf808d526ea26fbd76866e662756cc85c913c WatchSource:0}: Error finding container e778682f5e5a3424a1b773d54bebf808d526ea26fbd76866e662756cc85c913c: Status 404 returned error can't find the container with id e778682f5e5a3424a1b773d54bebf808d526ea26fbd76866e662756cc85c913c Jun 08 13:05:17.697218 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.695964 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jkftg"] Jun 08 13:05:17.792405 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:17.792374 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf3d1ae_5f72_438e_b536_1e0d26db4369.slice/crio-ca1677bcb3f59aa755a41cd9e786335fb981e66d4f4109c84b38102fc474c4c9 WatchSource:0}: Error finding container ca1677bcb3f59aa755a41cd9e786335fb981e66d4f4109c84b38102fc474c4c9: Status 404 returned error can't find the container with id ca1677bcb3f59aa755a41cd9e786335fb981e66d4f4109c84b38102fc474c4c9 Jun 08 13:05:17.800514 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.800490 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q"] Jun 08 13:05:17.834450 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.834427 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd"] Jun 08 13:05:17.838750 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:17.838723 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf38b37e_d7bd_4491_a242_71cf9d30f483.slice/crio-80af6ee3c14362513a794df77286c03b791ae7a20c8d0f17c158df9547b6d837 WatchSource:0}: Error finding container 80af6ee3c14362513a794df77286c03b791ae7a20c8d0f17c158df9547b6d837: Status 404 returned error can't find the container with id 80af6ee3c14362513a794df77286c03b791ae7a20c8d0f17c158df9547b6d837 Jun 08 13:05:17.930523 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:17.930486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:17.930776 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:17.930651 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:17.930776 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:17.930724 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:18.930708195 +0000 UTC m=+257.678758164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:18.012955 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.012749 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg"] Jun 08 13:05:18.018217 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.016671 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86"] Jun 08 13:05:18.022693 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:18.022670 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3378f7_99df_4841_b3ce_148fe5b162f8.slice/crio-a1af512debe0d76f574b37d2ae54c3362fa8c0158f8da40fa706801d7c34d658 WatchSource:0}: Error finding container a1af512debe0d76f574b37d2ae54c3362fa8c0158f8da40fa706801d7c34d658: Status 404 returned error can't find the container with id a1af512debe0d76f574b37d2ae54c3362fa8c0158f8da40fa706801d7c34d658 Jun 08 13:05:18.563013 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.562873 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4xcqm" event={"ID":"0ec7a948-9cbb-49b6-b141-fd4fec23853c","Type":"ContainerStarted","Data":"e778682f5e5a3424a1b773d54bebf808d526ea26fbd76866e662756cc85c913c"} Jun 08 13:05:18.565797 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.565762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" event={"ID":"af38b37e-d7bd-4491-a242-71cf9d30f483","Type":"ContainerStarted","Data":"80af6ee3c14362513a794df77286c03b791ae7a20c8d0f17c158df9547b6d837"} Jun 08 13:05:18.569116 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.569088 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" event={"ID":"6720ced6-58e0-45fc-9f12-332f91ba9cf5","Type":"ContainerStarted","Data":"050536ab41df931bf5112d1b77d14e8d1a4b32827d2ce47f2c2bbce72908fac6"} Jun 08 13:05:18.570970 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.570943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" event={"ID":"0a3378f7-99df-4841-b3ce-148fe5b162f8","Type":"ContainerStarted","Data":"a1af512debe0d76f574b37d2ae54c3362fa8c0158f8da40fa706801d7c34d658"} Jun 08 13:05:18.577195 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.576811 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" event={"ID":"edf3d1ae-5f72-438e-b536-1e0d26db4369","Type":"ContainerStarted","Data":"d5cc94dd39e553f5b3915486db171b54716b9d9ea7611190d88f94ae99c6a911"} Jun 08 13:05:18.577195 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.576853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" event={"ID":"edf3d1ae-5f72-438e-b536-1e0d26db4369","Type":"ContainerStarted","Data":"ca1677bcb3f59aa755a41cd9e786335fb981e66d4f4109c84b38102fc474c4c9"} Jun 08 13:05:18.580153 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.580092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" event={"ID":"a4e5afe6-69a8-47a2-ac61-ed7ab109c913","Type":"ContainerStarted","Data":"7634c9a5d601285d13051c37d9875134b8ea4b6854d67ca09af8f407e16f067a"} Jun 08 13:05:18.942832 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:18.942247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:18.942832 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:18.942415 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:18.942832 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:18.942482 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:20.942460643 +0000 UTC m=+259.690510607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:20.960813 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:20.960771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:20.961316 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:20.960948 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:20.961316 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:20.961030 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:24.961009221 +0000 UTC m=+263.709059187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:22.593589 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.593547 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" event={"ID":"0a3378f7-99df-4841-b3ce-148fe5b162f8","Type":"ContainerStarted","Data":"e754b3b76e8454fc7841e73211f06c969306d75690e9eda6bbc19a503e0b747d"} Jun 08 13:05:22.595235 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.595214 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/0.log" Jun 08 13:05:22.595371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.595248 2573 generic.go:356] "Generic (PLEG): container finished" podID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" containerID="d558130e6b04643ba28f31e5c110f3226cd00fbc04fc4b1b9fb53e3a2be8248e" exitCode=255 Jun 08 13:05:22.595371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.595304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" event={"ID":"a4e5afe6-69a8-47a2-ac61-ed7ab109c913","Type":"ContainerDied","Data":"d558130e6b04643ba28f31e5c110f3226cd00fbc04fc4b1b9fb53e3a2be8248e"} Jun 08 13:05:22.595546 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.595531 2573 scope.go:117] "RemoveContainer" containerID="d558130e6b04643ba28f31e5c110f3226cd00fbc04fc4b1b9fb53e3a2be8248e" Jun 08 13:05:22.596833 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.596809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4xcqm" event={"ID":"0ec7a948-9cbb-49b6-b141-fd4fec23853c","Type":"ContainerStarted","Data":"6e35c88aab15a875c46dd7bdbba5aab6028a3d9d75a90377fcf89b08dcdb767e"} Jun 08 13:05:22.598206 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.598184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" event={"ID":"af38b37e-d7bd-4491-a242-71cf9d30f483","Type":"ContainerStarted","Data":"0fcbfc87c1732f124b65b06c5e76ceacb40e393ebe74dacb411cd689873734f7"} Jun 08 13:05:22.599693 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.599670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" event={"ID":"6720ced6-58e0-45fc-9f12-332f91ba9cf5","Type":"ContainerStarted","Data":"167862fe5a1831ceaac0a55907f78691f3bd543f5ef887c2a7ceab2c35ede987"} Jun 08 13:05:22.621614 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.621569 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5fg6q" podStartSLOduration=5.621553598 podStartE2EDuration="5.621553598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:18.597625502 +0000 UTC m=+257.345675485" watchObservedRunningTime="2026-06-08 13:05:22.621553598 +0000 UTC m=+261.369603583" Jun 08 13:05:22.621814 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.621791 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-lqs86" podStartSLOduration=4.09093819 podStartE2EDuration="5.621784939s" totalImagesPullingTime="1.530846749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:22.620938841 +0000 UTC m=+261.368988824" watchObservedRunningTime="2026-06-08 13:05:22.621784939 +0000 UTC m=+261.369834920" Jun 08 13:05:22.648527 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.648471 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-4xcqm" podStartSLOduration=1.758447704 podStartE2EDuration="5.648444307s" totalImagesPullingTime="3.889996603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:22.647630894 +0000 UTC m=+261.395680869" watchObservedRunningTime="2026-06-08 13:05:22.648444307 +0000 UTC m=+261.396494292" Jun 08 13:05:22.705173 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.705115 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" podStartSLOduration=1.971784117 podStartE2EDuration="5.705094979s" totalImagesPullingTime="3.733310862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:22.704133286 +0000 UTC m=+261.452183263" watchObservedRunningTime="2026-06-08 13:05:22.705094979 +0000 UTC m=+261.453144943" Jun 08 13:05:22.784839 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.784786 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" podStartSLOduration=2.236128218 podStartE2EDuration="5.784769489s" totalImagesPullingTime="3.548641271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:22.784176478 +0000 UTC m=+261.532226460" watchObservedRunningTime="2026-06-08 13:05:22.784769489 +0000 UTC m=+261.532819470" Jun 08 13:05:22.942631 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.942598 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59"] Jun 08 13:05:22.945839 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.945813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" Jun 08 13:05:22.950326 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.950249 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 13:05:22.950460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.950369 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qbvnq\"" Jun 08 13:05:22.950519 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.950472 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:22.970106 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:22.970073 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59"] Jun 08 13:05:23.082265 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.082232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqk9\" (UniqueName: \"kubernetes.io/projected/0bf29a93-f38d-4f9b-9a70-f19cc2db54aa-kube-api-access-xdqk9\") pod \"migrator-955ffdf5f-vtn59\" (UID: \"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" Jun 08 13:05:23.183024 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.182980 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqk9\" (UniqueName: \"kubernetes.io/projected/0bf29a93-f38d-4f9b-9a70-f19cc2db54aa-kube-api-access-xdqk9\") pod \"migrator-955ffdf5f-vtn59\" (UID: \"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" Jun 08 13:05:23.193722 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.193660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqk9\" (UniqueName: \"kubernetes.io/projected/0bf29a93-f38d-4f9b-9a70-f19cc2db54aa-kube-api-access-xdqk9\") pod \"migrator-955ffdf5f-vtn59\" (UID: \"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" Jun 08 13:05:23.255533 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.255503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" Jun 08 13:05:23.380983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.380943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59"] Jun 08 13:05:23.383947 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:23.383909 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf29a93_f38d_4f9b_9a70_f19cc2db54aa.slice/crio-1c09cb5e190f45aa6e373facbdccbff7b38d371564ef5bff79ac3a3cb8047a2f WatchSource:0}: Error finding container 1c09cb5e190f45aa6e373facbdccbff7b38d371564ef5bff79ac3a3cb8047a2f: Status 404 returned error can't find the container with id 1c09cb5e190f45aa6e373facbdccbff7b38d371564ef5bff79ac3a3cb8047a2f Jun 08 13:05:23.603676 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.603582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" event={"ID":"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa","Type":"ContainerStarted","Data":"1c09cb5e190f45aa6e373facbdccbff7b38d371564ef5bff79ac3a3cb8047a2f"} Jun 08 13:05:23.605008 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.604989 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/1.log" Jun 08 13:05:23.605371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.605356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/0.log" Jun 08 13:05:23.605444 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.605391 2573 generic.go:356] "Generic (PLEG): container finished" podID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" exitCode=255 Jun 08 13:05:23.605503 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.605488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" event={"ID":"a4e5afe6-69a8-47a2-ac61-ed7ab109c913","Type":"ContainerDied","Data":"a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f"} Jun 08 13:05:23.605541 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.605531 2573 scope.go:117] "RemoveContainer" containerID="d558130e6b04643ba28f31e5c110f3226cd00fbc04fc4b1b9fb53e3a2be8248e" Jun 08 13:05:23.605693 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:23.605659 2573 scope.go:117] "RemoveContainer" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" Jun 08 13:05:23.605882 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:23.605863 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jkftg_openshift-console-operator(a4e5afe6-69a8-47a2-ac61-ed7ab109c913)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" Jun 08 13:05:24.612102 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:24.612073 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" event={"ID":"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa","Type":"ContainerStarted","Data":"bf6268445d34a9bacad0592a291ea4ca6f193f79762a6bf605e46925fd676938"} Jun 08 13:05:24.614462 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:24.614433 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/1.log" Jun 08 13:05:24.614733 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:24.614721 2573 scope.go:117] "RemoveContainer" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" Jun 08 13:05:24.614871 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:24.614853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jkftg_openshift-console-operator(a4e5afe6-69a8-47a2-ac61-ed7ab109c913)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" Jun 08 13:05:24.999002 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:24.998957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:24.999224 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:24.999100 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:24.999224 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:24.999151 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:32.999138101 +0000 UTC m=+271.747188061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:25.451886 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.451852 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bs48h"] Jun 08 13:05:25.454759 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.454744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.458343 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.458324 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 13:05:25.458343 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.458333 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 13:05:25.458500 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.458371 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 13:05:25.459266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.459246 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 13:05:25.459515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.459499 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cscqz\"" Jun 08 13:05:25.482201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.482178 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bs48h"] Jun 08 13:05:25.602922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.602879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5dac861-350d-4169-81b2-ad76c904e914-signing-cabundle\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.602922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.602924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkxm\" (UniqueName: \"kubernetes.io/projected/b5dac861-350d-4169-81b2-ad76c904e914-kube-api-access-lxkxm\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.603158 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.602978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5dac861-350d-4169-81b2-ad76c904e914-signing-key\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.619194 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.619155 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" event={"ID":"0bf29a93-f38d-4f9b-9a70-f19cc2db54aa","Type":"ContainerStarted","Data":"509414d504adedf97d601ebf57e7037ed912a67c802624b80c1cbb62d619c12f"} Jun 08 13:05:25.657976 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.657929 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vtn59" podStartSLOduration=2.497457589 podStartE2EDuration="3.657913054s" totalImagesPullingTime="1.160455465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:25.657602551 +0000 UTC m=+264.405652556" watchObservedRunningTime="2026-06-08 13:05:25.657913054 +0000 UTC m=+264.405963035" Jun 08 13:05:25.704380 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.704305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5dac861-350d-4169-81b2-ad76c904e914-signing-cabundle\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.704380 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.704347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkxm\" (UniqueName: \"kubernetes.io/projected/b5dac861-350d-4169-81b2-ad76c904e914-kube-api-access-lxkxm\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.704380 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.704368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5dac861-350d-4169-81b2-ad76c904e914-signing-key\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.705138 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.705113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5dac861-350d-4169-81b2-ad76c904e914-signing-cabundle\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.706824 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.706802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5dac861-350d-4169-81b2-ad76c904e914-signing-key\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.716974 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.716950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkxm\" (UniqueName: \"kubernetes.io/projected/b5dac861-350d-4169-81b2-ad76c904e914-kube-api-access-lxkxm\") pod \"service-ca-7d74d578b8-bs48h\" (UID: \"b5dac861-350d-4169-81b2-ad76c904e914\") " pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.763160 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.763127 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" Jun 08 13:05:25.770743 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.770721 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nwrs_9e1a4991-f8b9-426c-8d3a-e628e0f84084/dns-node-resolver/0.log" Jun 08 13:05:25.893788 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:25.893760 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bs48h"] Jun 08 13:05:25.896519 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:25.896480 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5dac861_350d_4169_81b2_ad76c904e914.slice/crio-9901a36e0412f30674b119c4377481b8b5d696a191042ed48025d450b55f13eb WatchSource:0}: Error finding container 9901a36e0412f30674b119c4377481b8b5d696a191042ed48025d450b55f13eb: Status 404 returned error can't find the container with id 9901a36e0412f30674b119c4377481b8b5d696a191042ed48025d450b55f13eb Jun 08 13:05:26.624249 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:26.624213 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" event={"ID":"b5dac861-350d-4169-81b2-ad76c904e914","Type":"ContainerStarted","Data":"b8e46e460cc699c0aea0812fb860cb0c59c82e16e9d7610b7a670d4db273524a"} Jun 08 13:05:26.624718 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:26.624265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" event={"ID":"b5dac861-350d-4169-81b2-ad76c904e914","Type":"ContainerStarted","Data":"9901a36e0412f30674b119c4377481b8b5d696a191042ed48025d450b55f13eb"} Jun 08 13:05:26.655824 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:26.655777 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-bs48h" podStartSLOduration=1.655761621 podStartE2EDuration="1.655761621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:26.655097067 +0000 UTC m=+265.403147048" watchObservedRunningTime="2026-06-08 13:05:26.655761621 +0000 UTC m=+265.403811602" Jun 08 13:05:27.165366 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:27.165338 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxv7x_ca3339d3-e2a1-4cce-ba40-38936b775d80/node-ca/0.log" Jun 08 13:05:27.545909 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:27.545802 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:27.545909 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:27.545900 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:27.546406 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:27.546391 2573 scope.go:117] "RemoveContainer" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" Jun 08 13:05:27.546633 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:27.546611 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jkftg_openshift-console-operator(a4e5afe6-69a8-47a2-ac61-ed7ab109c913)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" Jun 08 13:05:27.568647 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:27.568609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkb5x_1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321/serve-healthcheck-canary/0.log" Jun 08 13:05:28.167398 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:28.167368 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vtn59_0bf29a93-f38d-4f9b-9a70-f19cc2db54aa/migrator/0.log" Jun 08 13:05:28.368474 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:28.368439 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vtn59_0bf29a93-f38d-4f9b-9a70-f19cc2db54aa/graceful-termination/0.log" Jun 08 13:05:28.582615 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:28.582534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9spjd_af38b37e-d7bd-4491-a242-71cf9d30f483/kube-storage-version-migrator-operator/0.log" Jun 08 13:05:33.067604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:33.067569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:33.067995 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:33.067717 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:33.067995 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:33.067788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls podName:d49a28a2-3e53-4f65-979d-9cbf25e7bb8b nodeName:}" failed. No retries permitted until 2026-06-08 13:05:49.067773721 +0000 UTC m=+287.815823687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-vkj85" (UID: "d49a28a2-3e53-4f65-979d-9cbf25e7bb8b") : secret "cluster-monitoring-operator-tls" not found Jun 08 13:05:39.689344 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:39.689312 2573 scope.go:117] "RemoveContainer" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" Jun 08 13:05:40.671842 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.671791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:05:40.672220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.672205 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/1.log" Jun 08 13:05:40.672315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.672240 2573 generic.go:356] "Generic (PLEG): container finished" podID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" containerID="633599ad2e8190621fc2ae0d2fba7ef2e8681ed62f92ea0b54eb742c056f5779" exitCode=255 Jun 08 13:05:40.672315 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.672272 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" event={"ID":"a4e5afe6-69a8-47a2-ac61-ed7ab109c913","Type":"ContainerDied","Data":"633599ad2e8190621fc2ae0d2fba7ef2e8681ed62f92ea0b54eb742c056f5779"} Jun 08 13:05:40.672454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.672326 2573 scope.go:117] "RemoveContainer" containerID="a2218832b16d69ac850e1e74ef52b746666b29be80b910809aaa91839501c55f" Jun 08 13:05:40.672631 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:40.672614 2573 scope.go:117] "RemoveContainer" containerID="633599ad2e8190621fc2ae0d2fba7ef2e8681ed62f92ea0b54eb742c056f5779" Jun 08 13:05:40.672786 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:40.672769 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jkftg_openshift-console-operator(a4e5afe6-69a8-47a2-ac61-ed7ab109c913)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" Jun 08 13:05:41.331602 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:41.331568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" podUID="a9f1f54d-4145-49e1-9f61-3f54b249e108" Jun 08 13:05:41.331946 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:41.331568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" Jun 08 13:05:41.676901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:41.676875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:05:41.677084 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:41.676954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:05:41.677084 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:41.676964 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:05:45.162684 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.162616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:05:45.163113 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.162718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:05:45.165052 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.165018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"image-registry-79666c7cd4-zt4sj\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:05:45.165052 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.165032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9f1f54d-4145-49e1-9f61-3f54b249e108-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-m24c2\" (UID: \"a9f1f54d-4145-49e1-9f61-3f54b249e108\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:05:45.263938 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.263902 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:05:45.266091 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.266059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5dc6374-af77-41d4-80b1-2223bdc90381-metrics-tls\") pod \"dns-default-2rfqd\" (UID: \"d5dc6374-af77-41d4-80b1-2223bdc90381\") " pod="openshift-dns/dns-default-2rfqd" Jun 08 13:05:45.281837 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.281809 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2kwt7\"" Jun 08 13:05:45.281951 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.281841 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7vtn7\"" Jun 08 13:05:45.288930 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.288911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" Jun 08 13:05:45.289016 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.288999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:05:45.476524 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.476490 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2"] Jun 08 13:05:45.479310 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:45.479285 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f1f54d_4145_49e1_9f61_3f54b249e108.slice/crio-d4dfad85786ec7aae8061c477358b433bd72c77fa958f0ba52d880544c04ea52 WatchSource:0}: Error finding container d4dfad85786ec7aae8061c477358b433bd72c77fa958f0ba52d880544c04ea52: Status 404 returned error can't find the container with id d4dfad85786ec7aae8061c477358b433bd72c77fa958f0ba52d880544c04ea52 Jun 08 13:05:45.493117 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.493097 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:05:45.495146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.495126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:05:45.498077 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:45.498054 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afaf409_b874_4541_bfa3_5caf9ffd71f0.slice/crio-5890cd1f8f10a2a25bf35b3666d413b5ac1780c47cac1c22283abdd9d2807ca8 WatchSource:0}: Error finding container 5890cd1f8f10a2a25bf35b3666d413b5ac1780c47cac1c22283abdd9d2807ca8: Status 404 returned error can't find the container with id 5890cd1f8f10a2a25bf35b3666d413b5ac1780c47cac1c22283abdd9d2807ca8 Jun 08 13:05:45.500255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.500239 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rfqd" Jun 08 13:05:45.664130 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.664109 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rfqd"] Jun 08 13:05:45.666150 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:45.666127 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dc6374_af77_41d4_80b1_2223bdc90381.slice/crio-d83f82f717439cf3f45e6f14786b901f6f86070272a659383bd6663e06b9b003 WatchSource:0}: Error finding container d83f82f717439cf3f45e6f14786b901f6f86070272a659383bd6663e06b9b003: Status 404 returned error can't find the container with id d83f82f717439cf3f45e6f14786b901f6f86070272a659383bd6663e06b9b003 Jun 08 13:05:45.692680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.692654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" event={"ID":"4afaf409-b874-4541-bfa3-5caf9ffd71f0","Type":"ContainerStarted","Data":"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372"} Jun 08 13:05:45.692778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.692704 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:05:45.692778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.692719 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" event={"ID":"4afaf409-b874-4541-bfa3-5caf9ffd71f0","Type":"ContainerStarted","Data":"5890cd1f8f10a2a25bf35b3666d413b5ac1780c47cac1c22283abdd9d2807ca8"} Jun 08 13:05:45.692778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.692731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rfqd" event={"ID":"d5dc6374-af77-41d4-80b1-2223bdc90381","Type":"ContainerStarted","Data":"d83f82f717439cf3f45e6f14786b901f6f86070272a659383bd6663e06b9b003"} Jun 08 13:05:45.692778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.692751 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" event={"ID":"a9f1f54d-4145-49e1-9f61-3f54b249e108","Type":"ContainerStarted","Data":"d4dfad85786ec7aae8061c477358b433bd72c77fa958f0ba52d880544c04ea52"} Jun 08 13:05:45.716938 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:45.716887 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" podStartSLOduration=283.716873824 podStartE2EDuration="4m43.716873824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:45.716596386 +0000 UTC m=+284.464646367" watchObservedRunningTime="2026-06-08 13:05:45.716873824 +0000 UTC m=+284.464923805" Jun 08 13:05:47.486602 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.486537 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5nmbd"] Jun 08 13:05:47.488795 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.488777 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.493721 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.493707 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:05:47.495312 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.495272 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:05:47.495410 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.495272 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h74dt\"" Jun 08 13:05:47.515785 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.515762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nmbd"] Jun 08 13:05:47.545325 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.545298 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:47.545448 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.545368 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:05:47.545650 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.545638 2573 scope.go:117] "RemoveContainer" containerID="633599ad2e8190621fc2ae0d2fba7ef2e8681ed62f92ea0b54eb742c056f5779" Jun 08 13:05:47.545805 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:47.545787 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jkftg_openshift-console-operator(a4e5afe6-69a8-47a2-ac61-ed7ab109c913)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" Jun 08 13:05:47.583025 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.582996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/410a4f3e-89a0-46f7-8f75-2c383058e92d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.583152 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.583119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/410a4f3e-89a0-46f7-8f75-2c383058e92d-data-volume\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.583220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.583193 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.583268 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.583228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/410a4f3e-89a0-46f7-8f75-2c383058e92d-crio-socket\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.583314 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.583298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbw2t\" (UniqueName: \"kubernetes.io/projected/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-api-access-fbw2t\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684486 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbw2t\" (UniqueName: \"kubernetes.io/projected/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-api-access-fbw2t\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684643 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/410a4f3e-89a0-46f7-8f75-2c383058e92d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684643 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/410a4f3e-89a0-46f7-8f75-2c383058e92d-data-volume\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684643 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684784 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/410a4f3e-89a0-46f7-8f75-2c383058e92d-crio-socket\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684836 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/410a4f3e-89a0-46f7-8f75-2c383058e92d-crio-socket\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.684905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.684889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/410a4f3e-89a0-46f7-8f75-2c383058e92d-data-volume\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.685252 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.685232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.687156 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.687131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/410a4f3e-89a0-46f7-8f75-2c383058e92d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.700584 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.700558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rfqd" event={"ID":"d5dc6374-af77-41d4-80b1-2223bdc90381","Type":"ContainerStarted","Data":"33768904d8354f56247fa29eb3d47ccdedd6d81015ecfc156440024e8e609e5e"} Jun 08 13:05:47.700736 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.700602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rfqd" event={"ID":"d5dc6374-af77-41d4-80b1-2223bdc90381","Type":"ContainerStarted","Data":"0023bfa8de851d529f908c6e25a7e955815dd448d0e0d15637dfed276f5d2fba"} Jun 08 13:05:47.700736 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.700674 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2rfqd" Jun 08 13:05:47.702247 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.702213 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" event={"ID":"a9f1f54d-4145-49e1-9f61-3f54b249e108","Type":"ContainerStarted","Data":"fd9346c56a7b4a5c7b6cdb1212b991cfa2591772c816afeadd5e15a761542d6d"} Jun 08 13:05:47.704097 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.704076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbw2t\" (UniqueName: \"kubernetes.io/projected/410a4f3e-89a0-46f7-8f75-2c383058e92d-kube-api-access-fbw2t\") pod \"insights-runtime-extractor-5nmbd\" (UID: \"410a4f3e-89a0-46f7-8f75-2c383058e92d\") " pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.735531 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.735480 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2rfqd" podStartSLOduration=250.910477413 podStartE2EDuration="4m12.73546391s" totalImagesPullingTime="1.824986497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:47.735107867 +0000 UTC m=+286.483157851" watchObservedRunningTime="2026-06-08 13:05:47.73546391 +0000 UTC m=+286.483513893" Jun 08 13:05:47.753768 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.753701 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-m24c2" podStartSLOduration=284.217035245 podStartE2EDuration="4m45.753689032s" totalImagesPullingTime="1.536653787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:47.753649571 +0000 UTC m=+286.501699563" watchObservedRunningTime="2026-06-08 13:05:47.753689032 +0000 UTC m=+286.501739014" Jun 08 13:05:47.798048 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.798009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nmbd" Jun 08 13:05:47.941590 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:47.941567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nmbd"] Jun 08 13:05:47.943588 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:47.943557 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410a4f3e_89a0_46f7_8f75_2c383058e92d.slice/crio-ccf00c4bb642f16397c79528eb915ce2afe2dd64ef28318a998a693c301c1122 WatchSource:0}: Error finding container ccf00c4bb642f16397c79528eb915ce2afe2dd64ef28318a998a693c301c1122: Status 404 returned error can't find the container with id ccf00c4bb642f16397c79528eb915ce2afe2dd64ef28318a998a693c301c1122 Jun 08 13:05:48.707955 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:48.707929 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nmbd" event={"ID":"410a4f3e-89a0-46f7-8f75-2c383058e92d","Type":"ContainerStarted","Data":"5d73173f397998362ab1a3497d3ddf760c8dbf78fc0d8206d202805372a0d073"} Jun 08 13:05:48.708373 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:48.707991 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nmbd" event={"ID":"410a4f3e-89a0-46f7-8f75-2c383058e92d","Type":"ContainerStarted","Data":"2c31dafb2aa2a7a9c10501aa5c8eb8072a50fc2465f9f64798f00a9c91a175dc"} Jun 08 13:05:48.708373 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:48.708023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nmbd" event={"ID":"410a4f3e-89a0-46f7-8f75-2c383058e92d","Type":"ContainerStarted","Data":"ccf00c4bb642f16397c79528eb915ce2afe2dd64ef28318a998a693c301c1122"} Jun 08 13:05:49.094782 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:49.094747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:49.097026 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:49.097005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49a28a2-3e53-4f65-979d-9cbf25e7bb8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-vkj85\" (UID: \"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:49.339054 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:49.339003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" Jun 08 13:05:49.482794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:49.482772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85"] Jun 08 13:05:49.485020 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:05:49.484995 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49a28a2_3e53_4f65_979d_9cbf25e7bb8b.slice/crio-f52e87726740677a17b4467e0aec76d61367af34bc52d6715fda139fbbbf19f4 WatchSource:0}: Error finding container f52e87726740677a17b4467e0aec76d61367af34bc52d6715fda139fbbbf19f4: Status 404 returned error can't find the container with id f52e87726740677a17b4467e0aec76d61367af34bc52d6715fda139fbbbf19f4 Jun 08 13:05:49.711539 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:49.711503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" event={"ID":"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b","Type":"ContainerStarted","Data":"f52e87726740677a17b4467e0aec76d61367af34bc52d6715fda139fbbbf19f4"} Jun 08 13:05:50.717104 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:50.717072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nmbd" event={"ID":"410a4f3e-89a0-46f7-8f75-2c383058e92d","Type":"ContainerStarted","Data":"dda2e5a35ed0713e761d70b7dbc8e7fa995632c05265e4625e4a7b5dd2f22078"} Jun 08 13:05:50.743370 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:50.743325 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5nmbd" podStartSLOduration=1.166432112 podStartE2EDuration="3.743302076s" totalImagesPullingTime="2.576869964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:05:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:50.74258625 +0000 UTC m=+289.490636235" watchObservedRunningTime="2026-06-08 13:05:50.743302076 +0000 UTC m=+289.491352058" Jun 08 13:05:51.722212 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:51.722169 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" event={"ID":"d49a28a2-3e53-4f65-979d-9cbf25e7bb8b","Type":"ContainerStarted","Data":"75ea610b5fe02f305a5663b37b482eeeadb8e2c9f32d3469cbbb4b0f32e3b4cd"} Jun 08 13:05:51.764057 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:51.763990 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-vkj85" podStartSLOduration=33.067002169 podStartE2EDuration="34.763976123s" totalImagesPullingTime="1.696973954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:51.763160254 +0000 UTC m=+290.511210237" watchObservedRunningTime="2026-06-08 13:05:51.763976123 +0000 UTC m=+290.512026104" Jun 08 13:05:57.690073 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:05:57.690017 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fd449" podUID="62bac6eb-61d6-444d-9df3-0107e1baa7f6" Jun 08 13:05:57.710666 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:57.710638 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2rfqd" Jun 08 13:05:59.972335 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.972297 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d"] Jun 08 13:05:59.975258 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.975240 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:05:59.981351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.981098 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 13:05:59.981351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.981195 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 13:05:59.982584 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.982562 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d6pzh\"" Jun 08 13:05:59.982712 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:05:59.982612 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:06:00.014442 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.014410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d"] Jun 08 13:06:00.058891 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.058855 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m"] Jun 08 13:06:00.061501 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.061481 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.067258 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.067235 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 13:06:00.067501 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.067488 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4kbns\"" Jun 08 13:06:00.067805 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.067783 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 13:06:00.068329 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.068308 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 13:06:00.083122 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.083096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9295\" (UniqueName: \"kubernetes.io/projected/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-kube-api-access-j9295\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.083209 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.083156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.083267 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.083222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.083308 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.083264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.102258 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.102238 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m"] Jun 08 13:06:00.151983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.151950 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-47q54"] Jun 08 13:06:00.154676 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.154660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.159563 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.159541 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:06:00.161610 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.161588 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c4gz5\"" Jun 08 13:06:00.161746 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.161623 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:06:00.162142 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.162126 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:06:00.184665 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.184641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.184781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.184677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.184781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.184699 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.184781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.184750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.184996 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.184976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.185033 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgxf\" (UniqueName: \"kubernetes.io/projected/6d559b15-4af6-4eed-b894-79a58582bc99-kube-api-access-glgxf\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.185115 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9295\" (UniqueName: \"kubernetes.io/projected/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-kube-api-access-j9295\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.185166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.185254 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.185323 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d559b15-4af6-4eed-b894-79a58582bc99-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.185446 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.185429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.186934 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.186915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.187091 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.187067 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.208206 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.208181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9295\" (UniqueName: \"kubernetes.io/projected/d2c5fb8a-d59f-4a91-a34c-393fc82da5ec-kube-api-access-j9295\") pod \"openshift-state-metrics-65f78d5c66-ccm8d\" (UID: \"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.285967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.285890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" Jun 08 13:06:00.286132 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286132 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-root\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286132 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glgxf\" (UniqueName: \"kubernetes.io/projected/6d559b15-4af6-4eed-b894-79a58582bc99-kube-api-access-glgxf\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286265 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg7fd\" (UniqueName: \"kubernetes.io/projected/bfb31783-685b-4ef6-9027-19d34016cc08-kube-api-access-xg7fd\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286265 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286265 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286265 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d559b15-4af6-4eed-b894-79a58582bc99-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286432 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-wtmp\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286432 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-accelerators-collector-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286432 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286432 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-tls\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286628 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286628 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-sys\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286628 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-textfile\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286628 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-metrics-client-ca\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.286818 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d559b15-4af6-4eed-b894-79a58582bc99-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.286958 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.287015 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.286986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d559b15-4af6-4eed-b894-79a58582bc99-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.288771 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.288676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.288864 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.288847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d559b15-4af6-4eed-b894-79a58582bc99-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.296531 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.296510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgxf\" (UniqueName: \"kubernetes.io/projected/6d559b15-4af6-4eed-b894-79a58582bc99-kube-api-access-glgxf\") pod \"kube-state-metrics-57bbf8bfb5-rpv4m\" (UID: \"6d559b15-4af6-4eed-b894-79a58582bc99\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.370430 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.370395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" Jun 08 13:06:00.387347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387320 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-root\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387359 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg7fd\" (UniqueName: \"kubernetes.io/projected/bfb31783-685b-4ef6-9027-19d34016cc08-kube-api-access-xg7fd\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-wtmp\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-accelerators-collector-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-root\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.387723 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-tls\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-sys\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-wtmp\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.387544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfb31783-685b-4ef6-9027-19d34016cc08-sys\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388227 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.388188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-textfile\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388227 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.388223 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-metrics-client-ca\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388328 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.388245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-accelerators-collector-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.388482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-textfile\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.388759 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.388740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfb31783-685b-4ef6-9027-19d34016cc08-metrics-client-ca\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.390718 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.390662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-tls\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.391384 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.391351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfb31783-685b-4ef6-9027-19d34016cc08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.398495 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.398469 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg7fd\" (UniqueName: \"kubernetes.io/projected/bfb31783-685b-4ef6-9027-19d34016cc08-kube-api-access-xg7fd\") pod \"node-exporter-47q54\" (UID: \"bfb31783-685b-4ef6-9027-19d34016cc08\") " pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.424410 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.424383 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d"] Jun 08 13:06:00.431247 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:06:00.431215 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c5fb8a_d59f_4a91_a34c_393fc82da5ec.slice/crio-5cddf9dcc098156a02d9b7d10270a01b41d71a4ffdb42c37ba6ebb605d5069b8 WatchSource:0}: Error finding container 5cddf9dcc098156a02d9b7d10270a01b41d71a4ffdb42c37ba6ebb605d5069b8: Status 404 returned error can't find the container with id 5cddf9dcc098156a02d9b7d10270a01b41d71a4ffdb42c37ba6ebb605d5069b8 Jun 08 13:06:00.464371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.464150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47q54" Jun 08 13:06:00.484414 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:06:00.484377 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb31783_685b_4ef6_9027_19d34016cc08.slice/crio-6358a6708192d3e1e1e606ee4af86db4594edf3b66d0d4d5c75e720d7cff2d02 WatchSource:0}: Error finding container 6358a6708192d3e1e1e606ee4af86db4594edf3b66d0d4d5c75e720d7cff2d02: Status 404 returned error can't find the container with id 6358a6708192d3e1e1e606ee4af86db4594edf3b66d0d4d5c75e720d7cff2d02 Jun 08 13:06:00.530167 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.530139 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m"] Jun 08 13:06:00.533380 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:06:00.533075 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d559b15_4af6_4eed_b894_79a58582bc99.slice/crio-2bdfa18328dc017c9f35364990b850de7aa03241dff2e8c796eda379d58e1746 WatchSource:0}: Error finding container 2bdfa18328dc017c9f35364990b850de7aa03241dff2e8c796eda379d58e1746: Status 404 returned error can't find the container with id 2bdfa18328dc017c9f35364990b850de7aa03241dff2e8c796eda379d58e1746 Jun 08 13:06:00.690034 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.690005 2573 scope.go:117] "RemoveContainer" containerID="633599ad2e8190621fc2ae0d2fba7ef2e8681ed62f92ea0b54eb742c056f5779" Jun 08 13:06:00.754178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.754142 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" event={"ID":"6d559b15-4af6-4eed-b894-79a58582bc99","Type":"ContainerStarted","Data":"2bdfa18328dc017c9f35364990b850de7aa03241dff2e8c796eda379d58e1746"} Jun 08 13:06:00.755545 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.755516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47q54" event={"ID":"bfb31783-685b-4ef6-9027-19d34016cc08","Type":"ContainerStarted","Data":"6358a6708192d3e1e1e606ee4af86db4594edf3b66d0d4d5c75e720d7cff2d02"} Jun 08 13:06:00.757294 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.757276 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:06:00.757401 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.757356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" event={"ID":"a4e5afe6-69a8-47a2-ac61-ed7ab109c913","Type":"ContainerStarted","Data":"2ce0645c6fcbc68eea5d717c6bed7249268913184bc4dac973ff0cc1e05eadb1"} Jun 08 13:06:00.757677 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.757660 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:06:00.759344 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.759320 2573 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-jkftg container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Jun 08 13:06:00.759456 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.759380 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podUID="a4e5afe6-69a8-47a2-ac61-ed7ab109c913" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Jun 08 13:06:00.759547 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.759508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" event={"ID":"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec","Type":"ContainerStarted","Data":"ecf31216a5f5637f60c5f9f0454c1e7f9fabd0eeb317018c89fd64e9376d6935"} Jun 08 13:06:00.759608 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.759561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" event={"ID":"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec","Type":"ContainerStarted","Data":"2c272420934a720bde556a54925f8e3403c14f523f5e7c49bcbb0723e4120ded"} Jun 08 13:06:00.759608 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.759589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" event={"ID":"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec","Type":"ContainerStarted","Data":"5cddf9dcc098156a02d9b7d10270a01b41d71a4ffdb42c37ba6ebb605d5069b8"} Jun 08 13:06:00.787345 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:00.787260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" podStartSLOduration=39.9217316 podStartE2EDuration="43.787244823s" totalImagesPullingTime="3.865513223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:00.786507123 +0000 UTC m=+299.534557104" watchObservedRunningTime="2026-06-08 13:06:00.787244823 +0000 UTC m=+299.535294851" Jun 08 13:06:01.765729 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:01.765531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47q54" event={"ID":"bfb31783-685b-4ef6-9027-19d34016cc08","Type":"ContainerStarted","Data":"a8ac7f938ee82662b07e8c6642cd0bf4544831f35439edbb25ab9beae7b30180"} Jun 08 13:06:01.995447 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:01.995413 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-jkftg" Jun 08 13:06:02.065779 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.065758 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:06:02.065888 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.065814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:06:02.090133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.090108 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:06:02.090780 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.090664 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:06:02.094792 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.094771 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:06:02.771131 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.771092 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfb31783-685b-4ef6-9027-19d34016cc08" containerID="a8ac7f938ee82662b07e8c6642cd0bf4544831f35439edbb25ab9beae7b30180" exitCode=0 Jun 08 13:06:02.771569 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.771179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47q54" event={"ID":"bfb31783-685b-4ef6-9027-19d34016cc08","Type":"ContainerDied","Data":"a8ac7f938ee82662b07e8c6642cd0bf4544831f35439edbb25ab9beae7b30180"} Jun 08 13:06:02.773396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.773287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" event={"ID":"d2c5fb8a-d59f-4a91-a34c-393fc82da5ec","Type":"ContainerStarted","Data":"c47f8c2dc086702714453dd616f3d4f221920fd246f6430f6af9bb9c86034dba"} Jun 08 13:06:02.775284 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.775262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" event={"ID":"6d559b15-4af6-4eed-b894-79a58582bc99","Type":"ContainerStarted","Data":"7285309e7d3872ffb63e0a31ce6f2e051ba67f3eb5b48df883b00695683381a2"} Jun 08 13:06:02.775422 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.775311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" event={"ID":"6d559b15-4af6-4eed-b894-79a58582bc99","Type":"ContainerStarted","Data":"803c554982e777857465ea836411136156f6c321844c4d7287e6fa81e8a8fc38"} Jun 08 13:06:02.775422 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.775334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" event={"ID":"6d559b15-4af6-4eed-b894-79a58582bc99","Type":"ContainerStarted","Data":"450579f14a9d7d49b4b21ba9938eca1fd71a5d1ee1968ad6fe02c0316f035e8a"} Jun 08 13:06:02.872938 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.872887 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-rpv4m" podStartSLOduration=1.356409185 podStartE2EDuration="2.87286728s" totalImagesPullingTime="1.516458095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:02.872812581 +0000 UTC m=+301.620862589" watchObservedRunningTime="2026-06-08 13:06:02.87286728 +0000 UTC m=+301.620917262" Jun 08 13:06:02.904573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:02.904531 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ccm8d" podStartSLOduration=2.405969334 podStartE2EDuration="3.90451688s" totalImagesPullingTime="1.498547546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:02.903856304 +0000 UTC m=+301.651906285" watchObservedRunningTime="2026-06-08 13:06:02.90451688 +0000 UTC m=+301.652566888" Jun 08 13:06:03.781229 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:03.781185 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47q54" event={"ID":"bfb31783-685b-4ef6-9027-19d34016cc08","Type":"ContainerStarted","Data":"b4d6798666b574939fd069167cc6fe3534754afbfc60fe50e580769939d88719"} Jun 08 13:06:03.781630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:03.781251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47q54" event={"ID":"bfb31783-685b-4ef6-9027-19d34016cc08","Type":"ContainerStarted","Data":"241c9150241343337de2ee9dacb89f55bd0924c24495516a0e319ef67d45b140"} Jun 08 13:06:04.561222 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.561155 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-47q54" podStartSLOduration=3.574789179 podStartE2EDuration="4.561130101s" totalImagesPullingTime="913.854409ms" totalInitContainerRuntime="72.486513ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:03.817429528 +0000 UTC m=+302.565479532" watchObservedRunningTime="2026-06-08 13:06:04.561130101 +0000 UTC m=+303.309180081" Jun 08 13:06:04.562487 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.562467 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sglxx"] Jun 08 13:06:04.565449 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.565430 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:04.569049 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.569014 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 13:06:04.569183 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.569016 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rbj72\"" Jun 08 13:06:04.585087 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.585063 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sglxx"] Jun 08 13:06:04.628340 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.628309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:04.628503 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.628394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whw9\" (UniqueName: \"kubernetes.io/projected/0de95c69-0a09-4736-a85e-85c87218e3f0-kube-api-access-6whw9\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:04.729787 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.729746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whw9\" (UniqueName: \"kubernetes.io/projected/0de95c69-0a09-4736-a85e-85c87218e3f0-kube-api-access-6whw9\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:04.729968 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.729938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:04.730113 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:06:04.730095 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 13:06:04.730196 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:06:04.730167 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert podName:0de95c69-0a09-4736-a85e-85c87218e3f0 nodeName:}" failed. No retries permitted until 2026-06-08 13:06:05.230147797 +0000 UTC m=+303.978197774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-sglxx" (UID: "0de95c69-0a09-4736-a85e-85c87218e3f0") : secret "monitoring-plugin-cert" not found Jun 08 13:06:04.757233 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:04.757200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whw9\" (UniqueName: \"kubernetes.io/projected/0de95c69-0a09-4736-a85e-85c87218e3f0-kube-api-access-6whw9\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:05.235073 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.235024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:05.237407 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.237379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0de95c69-0a09-4736-a85e-85c87218e3f0-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-sglxx\" (UID: \"0de95c69-0a09-4736-a85e-85c87218e3f0\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:05.293255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.293223 2573 patch_prober.go:28] interesting pod/image-registry-79666c7cd4-zt4sj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 13:06:05.293424 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.293281 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:06:05.474000 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.473965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:05.619878 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.619847 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-sglxx"] Jun 08 13:06:05.622677 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:06:05.622653 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de95c69_0a09_4736_a85e_85c87218e3f0.slice/crio-881c33e826fdb229b67a580592d886350b64460ad349ab6a19a1f2c2a03048d7 WatchSource:0}: Error finding container 881c33e826fdb229b67a580592d886350b64460ad349ab6a19a1f2c2a03048d7: Status 404 returned error can't find the container with id 881c33e826fdb229b67a580592d886350b64460ad349ab6a19a1f2c2a03048d7 Jun 08 13:06:05.624611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.624595 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:06:05.790480 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:05.790392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" event={"ID":"0de95c69-0a09-4736-a85e-85c87218e3f0","Type":"ContainerStarted","Data":"881c33e826fdb229b67a580592d886350b64460ad349ab6a19a1f2c2a03048d7"} Jun 08 13:06:06.557180 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.557147 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:06:06.559830 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.559813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.564438 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.564417 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 13:06:06.567461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.567438 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 13:06:06.567553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.567466 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 13:06:06.567553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.567444 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 13:06:06.567553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.567497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 13:06:06.567943 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.567929 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 13:06:06.568864 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.568664 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 13:06:06.568864 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.568690 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 13:06:06.568864 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.568699 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 13:06:06.568864 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.568702 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 13:06:06.569188 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.568908 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ktznt\"" Jun 08 13:06:06.569188 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.569001 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 13:06:06.570031 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.570015 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 13:06:06.578174 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.578159 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 13:06:06.582633 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.582610 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-flsm3bfoqo5f9\"" Jun 08 13:06:06.583711 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.583682 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 13:06:06.598069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.598028 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 13:06:06.607521 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.607500 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:06:06.647775 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.647922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.647922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.647922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.647922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.647922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647948 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.647988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rmr\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.648404 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.648325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.701238 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.701204 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:06:06.749306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749689 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.749772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rmr\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.749954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.750059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750526 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.750320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.750831 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.750577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.751248 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.751011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.753071 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.752879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.753199 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.753097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.753262 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.753223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.753262 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.753252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.753981 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.753686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.754128 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.754105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.754221 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.754166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.754221 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.754168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.754948 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.754924 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.755072 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.754953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.755147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.755107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.755361 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.755344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.755962 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.755946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.756213 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.756196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.781017 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.780992 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rmr\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr\") pod \"prometheus-k8s-0\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:06.870499 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:06.870425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:07.040820 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.040781 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:06:07.323392 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:06:07.323351 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891cbe8f_e305_4622_a83e_4ae5cc51d5a5.slice/crio-9a9599619b81260fea50b9eba26dc6fb336064e54ffe9461e5080c03f84fa33e WatchSource:0}: Error finding container 9a9599619b81260fea50b9eba26dc6fb336064e54ffe9461e5080c03f84fa33e: Status 404 returned error can't find the container with id 9a9599619b81260fea50b9eba26dc6fb336064e54ffe9461e5080c03f84fa33e Jun 08 13:06:07.800962 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.800925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"9a9599619b81260fea50b9eba26dc6fb336064e54ffe9461e5080c03f84fa33e"} Jun 08 13:06:07.802797 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.802773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" event={"ID":"0de95c69-0a09-4736-a85e-85c87218e3f0","Type":"ContainerStarted","Data":"2a89b116bb529f6193867bdaaf6a1b9fe59f3debe816f5234ff3ec3b8de8a6c4"} Jun 08 13:06:07.803087 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.803061 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:07.809213 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.809190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" Jun 08 13:06:07.822518 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:07.822473 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-sglxx" podStartSLOduration=2.098619043 podStartE2EDuration="3.822453869s" totalImagesPullingTime="1.723834826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:07.821324014 +0000 UTC m=+306.569373998" watchObservedRunningTime="2026-06-08 13:06:07.822453869 +0000 UTC m=+306.570503852" Jun 08 13:06:08.807966 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:08.807926 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="39e40edcb31ec6a0a09e8af7fbd5d32541a838d3f55e8099ed3794bae5608fb1" exitCode=0 Jun 08 13:06:08.808367 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:08.808003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"39e40edcb31ec6a0a09e8af7fbd5d32541a838d3f55e8099ed3794bae5608fb1"} Jun 08 13:06:09.637347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:09.637312 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:06:10.689574 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:10.689540 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:06:12.826540 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:12.826506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"4daa6373b1e4af91d116b540692f51d06d155bad6aa22f2c1ee11ab1f890be63"} Jun 08 13:06:12.826902 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:12.826595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"a683df5b4a6a015384440bfa1283a92dfc21901b6abd5513764c007be7d968ab"} Jun 08 13:06:14.837968 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:14.837878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"5ee50cfedd48c8a00aa1513ad9fc8e4d48d62848fa3e9570dc7b82c721df4cec"} Jun 08 13:06:14.837968 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:14.837947 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"b3329ae8cd084d718a6a72364c8b199cfb75c32fc5047ffc985f348e1d71c6d9"} Jun 08 13:06:14.838373 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:14.837973 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"8d51cb94b0b51ec909ca5a148e337471ba99808dc8b2fe8f204402e39997aa93"} Jun 08 13:06:14.838373 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:14.838000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerStarted","Data":"2a29b45b7c8d90d25c6792fbeab413b978afe839759dc71f4124f6d7b0ca12de"} Jun 08 13:06:14.881759 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:14.881701 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.627941122 podStartE2EDuration="8.881680949s" totalImagesPullingTime="6.234353428s" totalInitContainerRuntime="19.386399ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:14.881152292 +0000 UTC m=+313.629202274" watchObservedRunningTime="2026-06-08 13:06:14.881680949 +0000 UTC m=+313.629730931" Jun 08 13:06:16.870836 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:16.870804 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:06:27.890734 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:27.890698 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ec7a948-9cbb-49b6-b141-fd4fec23853c" containerID="6e35c88aab15a875c46dd7bdbba5aab6028a3d9d75a90377fcf89b08dcdb767e" exitCode=0 Jun 08 13:06:27.891158 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:27.890751 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4xcqm" event={"ID":"0ec7a948-9cbb-49b6-b141-fd4fec23853c","Type":"ContainerDied","Data":"6e35c88aab15a875c46dd7bdbba5aab6028a3d9d75a90377fcf89b08dcdb767e"} Jun 08 13:06:27.891158 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:27.891122 2573 scope.go:117] "RemoveContainer" containerID="6e35c88aab15a875c46dd7bdbba5aab6028a3d9d75a90377fcf89b08dcdb767e" Jun 08 13:06:28.628618 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:28.628589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rfqd_d5dc6374-af77-41d4-80b1-2223bdc90381/dns/0.log" Jun 08 13:06:28.839387 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:28.839357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rfqd_d5dc6374-af77-41d4-80b1-2223bdc90381/kube-rbac-proxy/0.log" Jun 08 13:06:28.896267 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:28.896233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4xcqm" event={"ID":"0ec7a948-9cbb-49b6-b141-fd4fec23853c","Type":"ContainerStarted","Data":"10531f810642a7119eda88f1660ad8fb04689333a2a18c032b23e8702accee76"} Jun 08 13:06:29.827666 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:29.827641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nwrs_9e1a4991-f8b9-426c-8d3a-e628e0f84084/dns-node-resolver/0.log" Jun 08 13:06:30.627374 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:30.627345 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkb5x_1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321/serve-healthcheck-canary/0.log" Jun 08 13:06:32.912257 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:32.912220 2573 generic.go:356] "Generic (PLEG): container finished" podID="6720ced6-58e0-45fc-9f12-332f91ba9cf5" containerID="167862fe5a1831ceaac0a55907f78691f3bd543f5ef887c2a7ceab2c35ede987" exitCode=0 Jun 08 13:06:32.912706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:32.912288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" event={"ID":"6720ced6-58e0-45fc-9f12-332f91ba9cf5","Type":"ContainerDied","Data":"167862fe5a1831ceaac0a55907f78691f3bd543f5ef887c2a7ceab2c35ede987"} Jun 08 13:06:32.912706 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:32.912606 2573 scope.go:117] "RemoveContainer" containerID="167862fe5a1831ceaac0a55907f78691f3bd543f5ef887c2a7ceab2c35ede987" Jun 08 13:06:33.918268 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:33.918233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-8lrkg" event={"ID":"6720ced6-58e0-45fc-9f12-332f91ba9cf5","Type":"ContainerStarted","Data":"ac5116f58a25bebcf0da6970362ea80a874bb91bd5d9892eed6f1d0c81806d4a"} Jun 08 13:06:34.660584 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.660540 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerName="registry" containerID="cri-o://d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372" gracePeriod=30 Jun 08 13:06:34.904597 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.904566 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:06:34.922783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.922706 2573 generic.go:356] "Generic (PLEG): container finished" podID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerID="d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372" exitCode=0 Jun 08 13:06:34.922783 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.922749 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" Jun 08 13:06:34.923174 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.922803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" event={"ID":"4afaf409-b874-4541-bfa3-5caf9ffd71f0","Type":"ContainerDied","Data":"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372"} Jun 08 13:06:34.923174 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.922875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79666c7cd4-zt4sj" event={"ID":"4afaf409-b874-4541-bfa3-5caf9ffd71f0","Type":"ContainerDied","Data":"5890cd1f8f10a2a25bf35b3666d413b5ac1780c47cac1c22283abdd9d2807ca8"} Jun 08 13:06:34.923174 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.922898 2573 scope.go:117] "RemoveContainer" containerID="d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372" Jun 08 13:06:34.931636 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.931612 2573 scope.go:117] "RemoveContainer" containerID="d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372" Jun 08 13:06:34.931917 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:06:34.931894 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372\": container with ID starting with d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372 not found: ID does not exist" containerID="d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372" Jun 08 13:06:34.931987 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:34.931926 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372"} err="failed to get container status \"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372\": rpc error: code = NotFound desc = could not find container \"d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372\": container with ID starting with d915839bc3fa6e6a38d79aaa1809ec0b280104a75e94faed70527b3b40411372 not found: ID does not exist" Jun 08 13:06:35.014221 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014194 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014240 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014266 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014462 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014407 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014506 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014467 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014545 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014519 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014594 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014552 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glrrc\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014645 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014594 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration\") pod \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\" (UID: \"4afaf409-b874-4541-bfa3-5caf9ffd71f0\") " Jun 08 13:06:35.014645 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014632 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:35.014823 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014675 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:35.015069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.014999 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-trusted-ca\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.015069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.015022 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-certificates\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.017237 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.017192 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:35.017237 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.017246 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:35.017476 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.017267 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc" (OuterVolumeSpecName: "kube-api-access-glrrc") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "kube-api-access-glrrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:35.017476 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.017333 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:35.017476 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.017342 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:35.023403 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.023377 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4afaf409-b874-4541-bfa3-5caf9ffd71f0" (UID: "4afaf409-b874-4541-bfa3-5caf9ffd71f0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:06:35.116013 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.115970 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-image-registry-private-configuration\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.116013 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.116006 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-registry-tls\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.116013 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.116020 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-bound-sa-token\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.116266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.116030 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4afaf409-b874-4541-bfa3-5caf9ffd71f0-ca-trust-extracted\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.116266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.116065 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4afaf409-b874-4541-bfa3-5caf9ffd71f0-installation-pull-secrets\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.116266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.116078 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrrc\" (UniqueName: \"kubernetes.io/projected/4afaf409-b874-4541-bfa3-5caf9ffd71f0-kube-api-access-glrrc\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:06:35.246113 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.246082 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:06:35.253189 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.253148 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79666c7cd4-zt4sj"] Jun 08 13:06:35.694507 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:35.694476 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" path="/var/lib/kubelet/pods/4afaf409-b874-4541-bfa3-5caf9ffd71f0/volumes" Jun 08 13:06:53.000201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:53.000156 2573 generic.go:356] "Generic (PLEG): container finished" podID="af38b37e-d7bd-4491-a242-71cf9d30f483" containerID="0fcbfc87c1732f124b65b06c5e76ceacb40e393ebe74dacb411cd689873734f7" exitCode=0 Jun 08 13:06:53.000662 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:53.000228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" event={"ID":"af38b37e-d7bd-4491-a242-71cf9d30f483","Type":"ContainerDied","Data":"0fcbfc87c1732f124b65b06c5e76ceacb40e393ebe74dacb411cd689873734f7"} Jun 08 13:06:53.000662 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:53.000537 2573 scope.go:117] "RemoveContainer" containerID="0fcbfc87c1732f124b65b06c5e76ceacb40e393ebe74dacb411cd689873734f7" Jun 08 13:06:54.005793 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:06:54.005759 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-9spjd" event={"ID":"af38b37e-d7bd-4491-a242-71cf9d30f483","Type":"ContainerStarted","Data":"4308b1c7bb7255ef08f8ff4312080deb660af47984cefe3066b6fd6a70094d95"} Jun 08 13:07:06.870735 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:06.870695 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:06.890680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:06.890655 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:07.071350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:07.071324 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:14.666408 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:14.666371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:07:14.668628 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:14.668605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62bac6eb-61d6-444d-9df3-0107e1baa7f6-metrics-certs\") pod \"network-metrics-daemon-fd449\" (UID: \"62bac6eb-61d6-444d-9df3-0107e1baa7f6\") " pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:07:14.893658 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:14.893629 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:07:14.900839 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:14.900816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd449" Jun 08 13:07:15.030942 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:15.030920 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd449"] Jun 08 13:07:15.033711 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:07:15.033687 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bac6eb_61d6_444d_9df3_0107e1baa7f6.slice/crio-5907b8dfccfd15b326ff4a0bfc1a5c8049e549489cb2460f6a608c452d6cbf02 WatchSource:0}: Error finding container 5907b8dfccfd15b326ff4a0bfc1a5c8049e549489cb2460f6a608c452d6cbf02: Status 404 returned error can't find the container with id 5907b8dfccfd15b326ff4a0bfc1a5c8049e549489cb2460f6a608c452d6cbf02 Jun 08 13:07:15.088312 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:15.088282 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd449" event={"ID":"62bac6eb-61d6-444d-9df3-0107e1baa7f6","Type":"ContainerStarted","Data":"5907b8dfccfd15b326ff4a0bfc1a5c8049e549489cb2460f6a608c452d6cbf02"} Jun 08 13:07:16.093625 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:16.093592 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd449" event={"ID":"62bac6eb-61d6-444d-9df3-0107e1baa7f6","Type":"ContainerStarted","Data":"096dd6baad543393900fb595636951bfff86f4b4cb32410f522f99c6c4735ff7"} Jun 08 13:07:16.093959 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:16.093644 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd449" event={"ID":"62bac6eb-61d6-444d-9df3-0107e1baa7f6","Type":"ContainerStarted","Data":"d2dd53072e540496c545b9c3623a01ab5ba3ae0acca0c76ae421f2cef8fc6303"} Jun 08 13:07:16.113919 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:16.113873 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fd449" podStartSLOduration=374.262454686 podStartE2EDuration="6m15.113857561s" totalImagesPullingTime="851.402875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:16.112161742 +0000 UTC m=+374.860211735" watchObservedRunningTime="2026-06-08 13:07:16.113857561 +0000 UTC m=+374.861907589" Jun 08 13:07:24.967091 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967052 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967354 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="prometheus" containerID="cri-o://a683df5b4a6a015384440bfa1283a92dfc21901b6abd5513764c007be7d968ab" gracePeriod=600 Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967368 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="thanos-sidecar" containerID="cri-o://2a29b45b7c8d90d25c6792fbeab413b978afe839759dc71f4124f6d7b0ca12de" gracePeriod=600 Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967364 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy" containerID="cri-o://b3329ae8cd084d718a6a72364c8b199cfb75c32fc5047ffc985f348e1d71c6d9" gracePeriod=600 Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967438 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-web" containerID="cri-o://8d51cb94b0b51ec909ca5a148e337471ba99808dc8b2fe8f204402e39997aa93" gracePeriod=600 Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967442 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5ee50cfedd48c8a00aa1513ad9fc8e4d48d62848fa3e9570dc7b82c721df4cec" gracePeriod=600 Jun 08 13:07:24.967604 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:24.967434 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="config-reloader" containerID="cri-o://4daa6373b1e4af91d116b540692f51d06d155bad6aa22f2c1ee11ab1f890be63" gracePeriod=600 Jun 08 13:07:25.132888 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132858 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="5ee50cfedd48c8a00aa1513ad9fc8e4d48d62848fa3e9570dc7b82c721df4cec" exitCode=0 Jun 08 13:07:25.132888 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132882 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="b3329ae8cd084d718a6a72364c8b199cfb75c32fc5047ffc985f348e1d71c6d9" exitCode=0 Jun 08 13:07:25.132888 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132889 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="8d51cb94b0b51ec909ca5a148e337471ba99808dc8b2fe8f204402e39997aa93" exitCode=0 Jun 08 13:07:25.132888 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132896 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="2a29b45b7c8d90d25c6792fbeab413b978afe839759dc71f4124f6d7b0ca12de" exitCode=0 Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132902 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="4daa6373b1e4af91d116b540692f51d06d155bad6aa22f2c1ee11ab1f890be63" exitCode=0 Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132907 2573 generic.go:356] "Generic (PLEG): container finished" podID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerID="a683df5b4a6a015384440bfa1283a92dfc21901b6abd5513764c007be7d968ab" exitCode=0 Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132926 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"5ee50cfedd48c8a00aa1513ad9fc8e4d48d62848fa3e9570dc7b82c721df4cec"} Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.132997 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"b3329ae8cd084d718a6a72364c8b199cfb75c32fc5047ffc985f348e1d71c6d9"} Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.133029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"8d51cb94b0b51ec909ca5a148e337471ba99808dc8b2fe8f204402e39997aa93"} Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.133076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"2a29b45b7c8d90d25c6792fbeab413b978afe839759dc71f4124f6d7b0ca12de"} Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.133101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"4daa6373b1e4af91d116b540692f51d06d155bad6aa22f2c1ee11ab1f890be63"} Jun 08 13:07:25.133166 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.133125 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"a683df5b4a6a015384440bfa1283a92dfc21901b6abd5513764c007be7d968ab"} Jun 08 13:07:25.210427 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.210402 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:25.258741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258665 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258726 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258752 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258777 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95rmr\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258804 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258833 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258858 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258913 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.258954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258942 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.258982 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259015 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259025 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259082 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259108 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259136 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259169 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259168 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259404 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259459 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259493 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259519 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config\") pod \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\" (UID: \"891cbe8f-e305-4622-a83e-4ae5cc51d5a5\") " Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259766 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.260277 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259785 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-metrics-client-ca\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.262065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259403 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.262065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.259810 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.262065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.260696 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.262065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.260768 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:07:25.262065 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.261153 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.262460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.262433 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:25.262539 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.262515 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.262640 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.262571 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.264225 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264197 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.264316 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264264 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config" (OuterVolumeSpecName: "config") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.264571 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264545 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.264650 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264594 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:07:25.264787 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264766 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.264928 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.264912 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.265204 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.265188 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out" (OuterVolumeSpecName: "config-out") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:07:25.265561 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.265546 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.265955 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.265935 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr" (OuterVolumeSpecName: "kube-api-access-95rmr") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "kube-api-access-95rmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:07:25.274600 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.274578 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config" (OuterVolumeSpecName: "web-config") pod "891cbe8f-e305-4622-a83e-4ae5cc51d5a5" (UID: "891cbe8f-e305-4622-a83e-4ae5cc51d5a5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:25.360688 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360650 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360688 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360683 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360697 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360710 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360723 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360734 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360748 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360760 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-db\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360772 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-grpc-tls\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360783 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360794 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360805 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config-out\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360817 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-tls-assets\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360828 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-config\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360839 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-metrics-client-certs\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360851 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95rmr\" (UniqueName: \"kubernetes.io/projected/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-kube-api-access-95rmr\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360866 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-web-config\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:25.360960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:25.360879 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/891cbe8f-e305-4622-a83e-4ae5cc51d5a5-secret-kube-rbac-proxy\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:07:26.140479 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.140445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"891cbe8f-e305-4622-a83e-4ae5cc51d5a5","Type":"ContainerDied","Data":"9a9599619b81260fea50b9eba26dc6fb336064e54ffe9461e5080c03f84fa33e"} Jun 08 13:07:26.140479 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.140467 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.140926 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.140535 2573 scope.go:117] "RemoveContainer" containerID="5ee50cfedd48c8a00aa1513ad9fc8e4d48d62848fa3e9570dc7b82c721df4cec" Jun 08 13:07:26.148333 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.148314 2573 scope.go:117] "RemoveContainer" containerID="b3329ae8cd084d718a6a72364c8b199cfb75c32fc5047ffc985f348e1d71c6d9" Jun 08 13:07:26.155603 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.155583 2573 scope.go:117] "RemoveContainer" containerID="8d51cb94b0b51ec909ca5a148e337471ba99808dc8b2fe8f204402e39997aa93" Jun 08 13:07:26.162200 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.162171 2573 scope.go:117] "RemoveContainer" containerID="2a29b45b7c8d90d25c6792fbeab413b978afe839759dc71f4124f6d7b0ca12de" Jun 08 13:07:26.167893 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.167869 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:26.170170 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.170150 2573 scope.go:117] "RemoveContainer" containerID="4daa6373b1e4af91d116b540692f51d06d155bad6aa22f2c1ee11ab1f890be63" Jun 08 13:07:26.171674 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.171654 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:26.177253 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.177231 2573 scope.go:117] "RemoveContainer" containerID="a683df5b4a6a015384440bfa1283a92dfc21901b6abd5513764c007be7d968ab" Jun 08 13:07:26.184339 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.184317 2573 scope.go:117] "RemoveContainer" containerID="39e40edcb31ec6a0a09e8af7fbd5d32541a838d3f55e8099ed3794bae5608fb1" Jun 08 13:07:26.202128 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202100 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:26.202407 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202395 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerName="registry" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202409 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerName="registry" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202419 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="thanos-sidecar" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202424 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="thanos-sidecar" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202434 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="prometheus" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202440 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="prometheus" Jun 08 13:07:26.202453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202452 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-thanos" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202457 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-thanos" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202466 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202472 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202480 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-web" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202486 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-web" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202493 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="config-reloader" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202498 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="config-reloader" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202507 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="init-config-reloader" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202512 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="init-config-reloader" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202556 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="thanos-sidecar" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202564 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202571 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-web" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202578 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="prometheus" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202584 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="kube-rbac-proxy-thanos" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202591 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4afaf409-b874-4541-bfa3-5caf9ffd71f0" containerName="registry" Jun 08 13:07:26.202619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.202597 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" containerName="config-reloader" Jun 08 13:07:26.207996 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.207979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.214984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215001 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215013 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215081 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215112 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 13:07:26.215147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215125 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 13:07:26.215493 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215484 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 13:07:26.215547 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215511 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 13:07:26.215597 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215567 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 13:07:26.215597 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215577 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ktznt\"" Jun 08 13:07:26.215597 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215578 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 13:07:26.215741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215615 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 13:07:26.215741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215512 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 13:07:26.215741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.215680 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 13:07:26.216131 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.216116 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-flsm3bfoqo5f9\"" Jun 08 13:07:26.219068 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.219053 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 13:07:26.223686 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.223669 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 13:07:26.225838 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.225817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:26.269024 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.268941 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269024 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.268978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269024 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269310 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269410 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zt6t\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-kube-api-access-8zt6t\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269841 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.269841 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.269603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.370870 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.370870 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.370995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zt6t\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-kube-api-access-8zt6t\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371304 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.371672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371613 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.372117 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.371697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.372257 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.372229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.372554 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.372527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.373208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.373178 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.373339 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.373313 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.374191 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.374167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.375178 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.375140 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.375279 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.375198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.375580 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.375553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376123 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.375781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376123 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.375997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376123 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.376032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.376150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.376186 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.376435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8348a2da-a2d0-472b-ab27-27aabad2f0f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.376883 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.376862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8348a2da-a2d0-472b-ab27-27aabad2f0f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.377352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.377333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.378184 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.378165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8348a2da-a2d0-472b-ab27-27aabad2f0f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.381299 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.381277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zt6t\" (UniqueName: \"kubernetes.io/projected/8348a2da-a2d0-472b-ab27-27aabad2f0f9-kube-api-access-8zt6t\") pod \"prometheus-k8s-0\" (UID: \"8348a2da-a2d0-472b-ab27-27aabad2f0f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.518275 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.518225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:07:26.663504 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:26.663471 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 13:07:26.666589 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:07:26.666553 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8348a2da_a2d0_472b_ab27_27aabad2f0f9.slice/crio-e373927d017fefa6cb8fe75671fe4d6e2e2555f4acfe72c98fca4412013f5eae WatchSource:0}: Error finding container e373927d017fefa6cb8fe75671fe4d6e2e2555f4acfe72c98fca4412013f5eae: Status 404 returned error can't find the container with id e373927d017fefa6cb8fe75671fe4d6e2e2555f4acfe72c98fca4412013f5eae Jun 08 13:07:27.145560 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:27.145525 2573 generic.go:356] "Generic (PLEG): container finished" podID="8348a2da-a2d0-472b-ab27-27aabad2f0f9" containerID="1ddde7df86787c9bb4c20f56f25a97d045f0d894dedabc526306c6b29c9915ba" exitCode=0 Jun 08 13:07:27.145992 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:27.145603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerDied","Data":"1ddde7df86787c9bb4c20f56f25a97d045f0d894dedabc526306c6b29c9915ba"} Jun 08 13:07:27.145992 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:27.145666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"e373927d017fefa6cb8fe75671fe4d6e2e2555f4acfe72c98fca4412013f5eae"} Jun 08 13:07:27.694117 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:27.694023 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="891cbe8f-e305-4622-a83e-4ae5cc51d5a5" path="/var/lib/kubelet/pods/891cbe8f-e305-4622-a83e-4ae5cc51d5a5/volumes" Jun 08 13:07:28.154703 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"f8f6209bab02fe3a09d38077a1d3d19786ab91701fae67de9c997b66a802a66e"} Jun 08 13:07:28.155145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154778 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"c9e8aebcc351e22a76397cc2156bdc986a1eeb44c875e9c513e2618ad562d609"} Jun 08 13:07:28.155145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154819 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"503f375f2d7c5814b7155f830d3d205cd28320bde9870292598d65872260efc2"} Jun 08 13:07:28.155145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"8e2b8e4c95f79d438250804d78a986f57c62460ee011d1a9b608d3e88f36d876"} Jun 08 13:07:28.155145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154916 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"91b85a5d4d23ec732c0be9ee3c5fdd1ddd9e6b78c3b0a7a04c63bbcf4dbaa4c7"} Jun 08 13:07:28.155145 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.154949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8348a2da-a2d0-472b-ab27-27aabad2f0f9","Type":"ContainerStarted","Data":"ccf17d912f3309d2e7b4a4bae3b9121e6a87a5dd93049af140db7aedd7fdb87f"} Jun 08 13:07:28.188785 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:28.188731 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.169389374 podStartE2EDuration="2.188714873s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.325499ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:28.185817152 +0000 UTC m=+386.933867169" watchObservedRunningTime="2026-06-08 13:07:28.188714873 +0000 UTC m=+386.936764866" Jun 08 13:07:31.519313 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:07:31.519267 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:08:26.518929 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:08:26.518822 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:08:26.534006 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:08:26.533981 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:08:27.409370 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:08:27.409341 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 13:10:52.763578 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.763540 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wppd8"] Jun 08 13:10:52.766927 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.766911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:52.769509 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.769483 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 13:10:52.769645 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.769542 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 13:10:52.770703 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.770682 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nvbrf\"" Jun 08 13:10:52.776489 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.776467 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wppd8"] Jun 08 13:10:52.928281 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.928245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:52.928487 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:52.928288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb897\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-kube-api-access-sb897\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.029010 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.028908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.029010 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.028965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb897\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-kube-api-access-sb897\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.038375 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.038349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.038511 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.038434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb897\" (UniqueName: \"kubernetes.io/projected/97065214-9f71-450c-a2df-d62d0f6ae96c-kube-api-access-sb897\") pod \"cert-manager-webhook-7dc76cbb94-wppd8\" (UID: \"97065214-9f71-450c-a2df-d62d0f6ae96c\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.084111 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.084076 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:53.212332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.212296 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wppd8"] Jun 08 13:10:53.215485 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:10:53.215453 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97065214_9f71_450c_a2df_d62d0f6ae96c.slice/crio-cfdb8d089d90335d86cc7493df0b95b8aa1b7a3fb5e5c4a6fd74cf9b2421e162 WatchSource:0}: Error finding container cfdb8d089d90335d86cc7493df0b95b8aa1b7a3fb5e5c4a6fd74cf9b2421e162: Status 404 returned error can't find the container with id cfdb8d089d90335d86cc7493df0b95b8aa1b7a3fb5e5c4a6fd74cf9b2421e162 Jun 08 13:10:53.947368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:53.947326 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" event={"ID":"97065214-9f71-450c-a2df-d62d0f6ae96c","Type":"ContainerStarted","Data":"cfdb8d089d90335d86cc7493df0b95b8aa1b7a3fb5e5c4a6fd74cf9b2421e162"} Jun 08 13:10:56.962918 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:56.962878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" event={"ID":"97065214-9f71-450c-a2df-d62d0f6ae96c","Type":"ContainerStarted","Data":"06b3fe31de08a0adca1b2e12e7bfab6611868deac7346d0b47914488254a6886"} Jun 08 13:10:56.963313 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:56.962943 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:10:56.981403 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:10:56.981359 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" podStartSLOduration=1.866910662 podStartE2EDuration="4.981343658s" totalImagesPullingTime="3.114432996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:10:56.980466589 +0000 UTC m=+595.728516552" watchObservedRunningTime="2026-06-08 13:10:56.981343658 +0000 UTC m=+595.729393639" Jun 08 13:11:02.110301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:02.110272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:11:02.112644 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:02.111441 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:11:02.118052 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:02.117985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:11:02.121009 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:02.120990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:11:02.968797 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:02.968769 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wppd8" Jun 08 13:11:11.949632 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.949593 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-csvkd"] Jun 08 13:11:11.952766 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.952746 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:11.955599 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.955574 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l22vh\"" Jun 08 13:11:11.963379 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.963358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-csvkd"] Jun 08 13:11:11.996722 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.996692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-bound-sa-token\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:11.996851 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:11.996751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnj9z\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-kube-api-access-lnj9z\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.098097 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.098062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnj9z\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-kube-api-access-lnj9z\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.098280 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.098119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-bound-sa-token\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.106934 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.106897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-bound-sa-token\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.107089 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.107016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnj9z\" (UniqueName: \"kubernetes.io/projected/3986c0c2-f0a2-46de-a4b7-6954978c687b-kube-api-access-lnj9z\") pod \"cert-manager-59c77684cc-csvkd\" (UID: \"3986c0c2-f0a2-46de-a4b7-6954978c687b\") " pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.261866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.261780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-csvkd" Jun 08 13:11:12.387880 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:12.387855 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-csvkd"] Jun 08 13:11:12.390216 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:11:12.390188 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3986c0c2_f0a2_46de_a4b7_6954978c687b.slice/crio-70964cf1dccd3a358388b856bf1b897e7de4039272da9bac29ebc1f0c1be90d2 WatchSource:0}: Error finding container 70964cf1dccd3a358388b856bf1b897e7de4039272da9bac29ebc1f0c1be90d2: Status 404 returned error can't find the container with id 70964cf1dccd3a358388b856bf1b897e7de4039272da9bac29ebc1f0c1be90d2 Jun 08 13:11:13.024426 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:13.024386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-csvkd" event={"ID":"3986c0c2-f0a2-46de-a4b7-6954978c687b","Type":"ContainerStarted","Data":"a48b81c3c3e6f6ae8924ed1bd3dcce4e10aa22858e3b57f5503f3144bfcc626c"} Jun 08 13:11:13.024868 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:13.024433 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-csvkd" event={"ID":"3986c0c2-f0a2-46de-a4b7-6954978c687b","Type":"ContainerStarted","Data":"70964cf1dccd3a358388b856bf1b897e7de4039272da9bac29ebc1f0c1be90d2"} Jun 08 13:11:13.041414 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:13.041367 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-csvkd" podStartSLOduration=2.041353426 podStartE2EDuration="2.041353426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:13.040460386 +0000 UTC m=+611.788510357" watchObservedRunningTime="2026-06-08 13:11:13.041353426 +0000 UTC m=+611.789403407" Jun 08 13:11:30.288524 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.288437 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6"] Jun 08 13:11:30.299680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.299655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.302919 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.302894 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:11:30.303146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.302952 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:11:30.303146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.302976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:11:30.303146 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.302984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:11:30.303421 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.303408 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pt5pq\"" Jun 08 13:11:30.310558 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.310536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6"] Jun 08 13:11:30.367399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.367367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.367399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.367401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.367581 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.367522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.367581 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.367550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.367650 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.367585 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncv6\" (UniqueName: \"kubernetes.io/projected/6576c09d-44d8-441a-be75-67ae041d7184-kube-api-access-xncv6\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468226 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468226 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468465 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xncv6\" (UniqueName: \"kubernetes.io/projected/6576c09d-44d8-441a-be75-67ae041d7184-kube-api-access-xncv6\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468465 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468465 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468341 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.468765 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.468744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.470669 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.470642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6576c09d-44d8-441a-be75-67ae041d7184-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.470807 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.470716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.470807 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.470773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6576c09d-44d8-441a-be75-67ae041d7184-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.481118 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.481097 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncv6\" (UniqueName: \"kubernetes.io/projected/6576c09d-44d8-441a-be75-67ae041d7184-kube-api-access-xncv6\") pod \"opendatahub-operator-controller-manager-677cd7f45-648w6\" (UID: \"6576c09d-44d8-441a-be75-67ae041d7184\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.611800 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.611709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:30.754332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.754300 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6"] Jun 08 13:11:30.757557 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:11:30.757520 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6576c09d_44d8_441a_be75_67ae041d7184.slice/crio-fdd5c689b01b5a668364875e30b6e21ee77fbebeec02bfa16ac81ca8e4b1664c WatchSource:0}: Error finding container fdd5c689b01b5a668364875e30b6e21ee77fbebeec02bfa16ac81ca8e4b1664c: Status 404 returned error can't find the container with id fdd5c689b01b5a668364875e30b6e21ee77fbebeec02bfa16ac81ca8e4b1664c Jun 08 13:11:30.759351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:30.759334 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:11:31.103055 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:31.102994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" event={"ID":"6576c09d-44d8-441a-be75-67ae041d7184","Type":"ContainerStarted","Data":"fdd5c689b01b5a668364875e30b6e21ee77fbebeec02bfa16ac81ca8e4b1664c"} Jun 08 13:11:34.120419 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:34.120388 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" event={"ID":"6576c09d-44d8-441a-be75-67ae041d7184","Type":"ContainerStarted","Data":"de5ec7bbc22432bf52a865897e6e7aa364779c723a9f5356c6047c9a5b5ccd24"} Jun 08 13:11:35.126798 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:35.126766 2573 generic.go:356] "Generic (PLEG): container finished" podID="6576c09d-44d8-441a-be75-67ae041d7184" containerID="de5ec7bbc22432bf52a865897e6e7aa364779c723a9f5356c6047c9a5b5ccd24" exitCode=0 Jun 08 13:11:35.127301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:35.126853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" event={"ID":"6576c09d-44d8-441a-be75-67ae041d7184","Type":"ContainerDied","Data":"de5ec7bbc22432bf52a865897e6e7aa364779c723a9f5356c6047c9a5b5ccd24"} Jun 08 13:11:36.135530 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:36.135484 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" event={"ID":"6576c09d-44d8-441a-be75-67ae041d7184","Type":"ContainerStarted","Data":"a2e3b4bb576dd49e112f67dce7e544508005e97e8558847a58e173cac86e2200"} Jun 08 13:11:36.136118 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:36.135585 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:11:36.160890 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:36.160843 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" podStartSLOduration=2.108815987 podStartE2EDuration="6.16082742s" totalImagesPullingTime="3.064545466s" totalInitContainerRuntime="987.465967ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:36.158562276 +0000 UTC m=+634.906612270" watchObservedRunningTime="2026-06-08 13:11:36.16082742 +0000 UTC m=+634.908877402" Jun 08 13:11:47.141695 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:11:47.141665 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-648w6" Jun 08 13:12:00.190278 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.190241 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k"] Jun 08 13:12:00.193593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.193576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.198070 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198030 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 13:12:00.198799 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198772 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 13:12:00.198918 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 13:12:00.198918 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198779 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:12:00.198918 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198780 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bmj75\"" Jun 08 13:12:00.198918 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.198780 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 13:12:00.215439 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.215417 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k"] Jun 08 13:12:00.226781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.226761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.226905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.226795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldd6t\" (UniqueName: \"kubernetes.io/projected/7e295113-7a3f-43a2-bb72-d5a4a32704b1-kube-api-access-ldd6t\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.226905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.226820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.226985 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.226939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e295113-7a3f-43a2-bb72-d5a4a32704b1-manager-config\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.327808 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.327774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e295113-7a3f-43a2-bb72-d5a4a32704b1-manager-config\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.327980 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.327822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.327980 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.327856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldd6t\" (UniqueName: \"kubernetes.io/projected/7e295113-7a3f-43a2-bb72-d5a4a32704b1-kube-api-access-ldd6t\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.327980 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.327879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.328475 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.328450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e295113-7a3f-43a2-bb72-d5a4a32704b1-manager-config\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.330363 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.330340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.330468 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.330443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e295113-7a3f-43a2-bb72-d5a4a32704b1-cert\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.342920 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.342899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldd6t\" (UniqueName: \"kubernetes.io/projected/7e295113-7a3f-43a2-bb72-d5a4a32704b1-kube-api-access-ldd6t\") pod \"lws-controller-manager-5cf59b74dc-9gn5k\" (UID: \"7e295113-7a3f-43a2-bb72-d5a4a32704b1\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.503119 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.503025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:00.647177 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:00.647146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k"] Jun 08 13:12:00.649899 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:12:00.649872 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e295113_7a3f_43a2_bb72_d5a4a32704b1.slice/crio-329b014564c31323795a526cc10913c9ccdf207ca0f509b309d1cb7553a6cffb WatchSource:0}: Error finding container 329b014564c31323795a526cc10913c9ccdf207ca0f509b309d1cb7553a6cffb: Status 404 returned error can't find the container with id 329b014564c31323795a526cc10913c9ccdf207ca0f509b309d1cb7553a6cffb Jun 08 13:12:01.251627 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:01.251594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" event={"ID":"7e295113-7a3f-43a2-bb72-d5a4a32704b1","Type":"ContainerStarted","Data":"329b014564c31323795a526cc10913c9ccdf207ca0f509b309d1cb7553a6cffb"} Jun 08 13:12:04.267967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:04.267932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" event={"ID":"7e295113-7a3f-43a2-bb72-d5a4a32704b1","Type":"ContainerStarted","Data":"2bd08de80b48b0a223a66476d21d0e9fb0e85c24a3c9ded0840ba1524efb5555"} Jun 08 13:12:04.268370 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:04.268062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:04.302094 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:04.302028 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" podStartSLOduration=1.559705357 podStartE2EDuration="4.302009278s" totalImagesPullingTime="2.742303921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:04.30147615 +0000 UTC m=+663.049526132" watchObservedRunningTime="2026-06-08 13:12:04.302009278 +0000 UTC m=+663.050059260" Jun 08 13:12:15.275462 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:15.275431 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-9gn5k" Jun 08 13:12:26.269253 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.269222 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn"] Jun 08 13:12:26.272495 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.272478 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.276264 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.276245 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wmtl5\"" Jun 08 13:12:26.277222 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.277199 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:12:26.277322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.277271 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 13:12:26.277322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.277297 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:12:26.295840 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.295816 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn"] Jun 08 13:12:26.458070 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdzxl\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-kube-api-access-qdzxl\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a545c-0822-4828-8575-54ff566d1f6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.458454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.458349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559411 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdzxl\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-kube-api-access-qdzxl\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559411 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559359 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559411 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a545c-0822-4828-8575-54ff566d1f6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559671 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.559951 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.560003 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.559970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.560072 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.560014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.560171 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.560149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.560356 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.560337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a9a545c-0822-4828-8575-54ff566d1f6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.561606 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.561585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.562021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.562004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.584095 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.584062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.584790 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.584771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdzxl\" (UniqueName: \"kubernetes.io/projected/0a9a545c-0822-4828-8575-54ff566d1f6c-kube-api-access-qdzxl\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjvssn\" (UID: \"0a9a545c-0822-4828-8575-54ff566d1f6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:26.882859 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:26.882782 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:27.014905 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:27.014881 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn"] Jun 08 13:12:27.017010 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:12:27.016967 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9a545c_0822_4828_8575_54ff566d1f6c.slice/crio-e8e5ade5fb4447719dbc62a1ded710e4501c3e318271d47ed2369d5d258e01a9 WatchSource:0}: Error finding container e8e5ade5fb4447719dbc62a1ded710e4501c3e318271d47ed2369d5d258e01a9: Status 404 returned error can't find the container with id e8e5ade5fb4447719dbc62a1ded710e4501c3e318271d47ed2369d5d258e01a9 Jun 08 13:12:27.371960 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:27.371925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" event={"ID":"0a9a545c-0822-4828-8575-54ff566d1f6c","Type":"ContainerStarted","Data":"e8e5ade5fb4447719dbc62a1ded710e4501c3e318271d47ed2369d5d258e01a9"} Jun 08 13:12:29.947981 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:29.947945 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:12:29.948257 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:29.948019 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:12:29.948257 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:29.948076 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:12:30.387610 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.387522 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" event={"ID":"0a9a545c-0822-4828-8575-54ff566d1f6c","Type":"ContainerStarted","Data":"d3f77639fa36094880971be5805a55077168e4058fe2931dadd88739cd44440b"} Jun 08 13:12:30.410838 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.410786 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" podStartSLOduration=1.482159968 podStartE2EDuration="4.410772552s" totalImagesPullingTime="2.928612584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:30.408680344 +0000 UTC m=+689.156730326" watchObservedRunningTime="2026-06-08 13:12:30.410772552 +0000 UTC m=+689.158822533" Jun 08 13:12:30.804221 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.804187 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-x26gx"] Jun 08 13:12:30.808199 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.808180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:30.811681 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.811658 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xxxqt\"" Jun 08 13:12:30.811681 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.811669 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 13:12:30.815719 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.815484 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-x26gx"] Jun 08 13:12:30.883162 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.883130 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:30.995912 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.995881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b062b656-ff51-4758-bc74-81b62e01b0a0-redirect-config\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:30.996330 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:30.996004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scz6w\" (UniqueName: \"kubernetes.io/projected/b062b656-ff51-4758-bc74-81b62e01b0a0-kube-api-access-scz6w\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.097191 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.097101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scz6w\" (UniqueName: \"kubernetes.io/projected/b062b656-ff51-4758-bc74-81b62e01b0a0-kube-api-access-scz6w\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.097354 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.097187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b062b656-ff51-4758-bc74-81b62e01b0a0-redirect-config\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.097875 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.097852 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b062b656-ff51-4758-bc74-81b62e01b0a0-redirect-config\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.105741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.105702 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scz6w\" (UniqueName: \"kubernetes.io/projected/b062b656-ff51-4758-bc74-81b62e01b0a0-kube-api-access-scz6w\") pod \"dashboard-redirect-7bc4849f48-x26gx\" (UID: \"b062b656-ff51-4758-bc74-81b62e01b0a0\") " pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.119696 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.119668 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" Jun 08 13:12:31.252144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.252100 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-x26gx"] Jun 08 13:12:31.256192 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:12:31.256164 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb062b656_ff51_4758_bc74_81b62e01b0a0.slice/crio-21561b0a73dbf77f4d8a138d98048018d3e6acc564189901196cfc8858872e2e WatchSource:0}: Error finding container 21561b0a73dbf77f4d8a138d98048018d3e6acc564189901196cfc8858872e2e: Status 404 returned error can't find the container with id 21561b0a73dbf77f4d8a138d98048018d3e6acc564189901196cfc8858872e2e Jun 08 13:12:31.393449 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.393420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" event={"ID":"b062b656-ff51-4758-bc74-81b62e01b0a0","Type":"ContainerStarted","Data":"21561b0a73dbf77f4d8a138d98048018d3e6acc564189901196cfc8858872e2e"} Jun 08 13:12:31.888458 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:31.888379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:32.399577 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:32.399544 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:32.401139 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:32.400933 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjvssn" Jun 08 13:12:34.414429 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:34.414390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" event={"ID":"b062b656-ff51-4758-bc74-81b62e01b0a0","Type":"ContainerStarted","Data":"bc3cf95520cce827d1e60842ced49e5c4e6947478b2e1bc822697bee013164b3"} Jun 08 13:12:34.430135 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:34.430085 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7bc4849f48-x26gx" podStartSLOduration=2.315425535 podStartE2EDuration="4.430071416s" totalImagesPullingTime="2.114645881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:34.429879386 +0000 UTC m=+693.177929370" watchObservedRunningTime="2026-06-08 13:12:34.430071416 +0000 UTC m=+693.178121397" Jun 08 13:12:50.844486 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.844449 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:50.852255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.852229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:50.855008 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.854987 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-f8lc5\"" Jun 08 13:12:50.856077 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.856025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:12:50.856077 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.856075 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:12:50.862445 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.862422 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:50.973194 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:50.973161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvkp\" (UniqueName: \"kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp\") pod \"kuadrant-operator-catalog-cm42n\" (UID: \"496055de-625b-4105-9cd7-896d6a15a15d\") " pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:51.074605 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.074561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvkp\" (UniqueName: \"kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp\") pod \"kuadrant-operator-catalog-cm42n\" (UID: \"496055de-625b-4105-9cd7-896d6a15a15d\") " pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:51.087827 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.087794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvkp\" (UniqueName: \"kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp\") pod \"kuadrant-operator-catalog-cm42n\" (UID: \"496055de-625b-4105-9cd7-896d6a15a15d\") " pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:51.164188 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.164158 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:51.206726 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.206696 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:51.295398 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.295300 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:51.300921 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:12:51.300892 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496055de_625b_4105_9cd7_896d6a15a15d.slice/crio-ea171fae50b7f5df000ef9a1c3dc93a0e226bae762406edde765858751ec6ebe WatchSource:0}: Error finding container ea171fae50b7f5df000ef9a1c3dc93a0e226bae762406edde765858751ec6ebe: Status 404 returned error can't find the container with id ea171fae50b7f5df000ef9a1c3dc93a0e226bae762406edde765858751ec6ebe Jun 08 13:12:51.418736 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.418659 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c4srh"] Jun 08 13:12:51.423623 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.423605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:12:51.433251 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.433226 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c4srh"] Jun 08 13:12:51.478400 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.478368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hsw\" (UniqueName: \"kubernetes.io/projected/e4497de2-4b59-4dda-9414-d9326057b68b-kube-api-access-62hsw\") pod \"kuadrant-operator-catalog-c4srh\" (UID: \"e4497de2-4b59-4dda-9414-d9326057b68b\") " pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:12:51.489747 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.489715 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" event={"ID":"496055de-625b-4105-9cd7-896d6a15a15d","Type":"ContainerStarted","Data":"ea171fae50b7f5df000ef9a1c3dc93a0e226bae762406edde765858751ec6ebe"} Jun 08 13:12:51.579427 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.579388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hsw\" (UniqueName: \"kubernetes.io/projected/e4497de2-4b59-4dda-9414-d9326057b68b-kube-api-access-62hsw\") pod \"kuadrant-operator-catalog-c4srh\" (UID: \"e4497de2-4b59-4dda-9414-d9326057b68b\") " pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:12:51.588312 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.588288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hsw\" (UniqueName: \"kubernetes.io/projected/e4497de2-4b59-4dda-9414-d9326057b68b-kube-api-access-62hsw\") pod \"kuadrant-operator-catalog-c4srh\" (UID: \"e4497de2-4b59-4dda-9414-d9326057b68b\") " pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:12:51.733626 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.733543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:12:51.876230 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:51.876205 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c4srh"] Jun 08 13:12:51.878251 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:12:51.878220 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4497de2_4b59_4dda_9414_d9326057b68b.slice/crio-9450d56ee0ce4635af74f57ee11027d91da07fdfb10e6adccf498722b27cce62 WatchSource:0}: Error finding container 9450d56ee0ce4635af74f57ee11027d91da07fdfb10e6adccf498722b27cce62: Status 404 returned error can't find the container with id 9450d56ee0ce4635af74f57ee11027d91da07fdfb10e6adccf498722b27cce62 Jun 08 13:12:52.495780 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:52.495745 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" event={"ID":"e4497de2-4b59-4dda-9414-d9326057b68b","Type":"ContainerStarted","Data":"9450d56ee0ce4635af74f57ee11027d91da07fdfb10e6adccf498722b27cce62"} Jun 08 13:12:54.505629 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.505594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" event={"ID":"e4497de2-4b59-4dda-9414-d9326057b68b","Type":"ContainerStarted","Data":"5236b669d9b8e0577a7f7d83928e1183664186aa598e8660c3a442168295d444"} Jun 08 13:12:54.506946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.506923 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" event={"ID":"496055de-625b-4105-9cd7-896d6a15a15d","Type":"ContainerStarted","Data":"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088"} Jun 08 13:12:54.507075 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.506987 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" podUID="496055de-625b-4105-9cd7-896d6a15a15d" containerName="registry-server" containerID="cri-o://65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088" gracePeriod=2 Jun 08 13:12:54.523912 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.523870 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" podStartSLOduration=1.8297531249999999 podStartE2EDuration="3.52385459s" totalImagesPullingTime="1.694101465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:54.521960738 +0000 UTC m=+713.270010735" watchObservedRunningTime="2026-06-08 13:12:54.52385459 +0000 UTC m=+713.271904571" Jun 08 13:12:54.540253 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.540202 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" podStartSLOduration=2.272178347 podStartE2EDuration="4.540183754s" totalImagesPullingTime="2.268005407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:54.538903114 +0000 UTC m=+713.286953095" watchObservedRunningTime="2026-06-08 13:12:54.540183754 +0000 UTC m=+713.288233736" Jun 08 13:12:54.751928 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.751899 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:54.808413 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.808336 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvkp\" (UniqueName: \"kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp\") pod \"496055de-625b-4105-9cd7-896d6a15a15d\" (UID: \"496055de-625b-4105-9cd7-896d6a15a15d\") " Jun 08 13:12:54.810522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.810494 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp" (OuterVolumeSpecName: "kube-api-access-9fvkp") pod "496055de-625b-4105-9cd7-896d6a15a15d" (UID: "496055de-625b-4105-9cd7-896d6a15a15d"). InnerVolumeSpecName "kube-api-access-9fvkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:12:54.910388 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:54.910349 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvkp\" (UniqueName: \"kubernetes.io/projected/496055de-625b-4105-9cd7-896d6a15a15d-kube-api-access-9fvkp\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:12:55.512672 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.512639 2573 generic.go:356] "Generic (PLEG): container finished" podID="496055de-625b-4105-9cd7-896d6a15a15d" containerID="65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088" exitCode=0 Jun 08 13:12:55.513140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.512693 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" Jun 08 13:12:55.513140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.512728 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" event={"ID":"496055de-625b-4105-9cd7-896d6a15a15d","Type":"ContainerDied","Data":"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088"} Jun 08 13:12:55.513140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.512802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cm42n" event={"ID":"496055de-625b-4105-9cd7-896d6a15a15d","Type":"ContainerDied","Data":"ea171fae50b7f5df000ef9a1c3dc93a0e226bae762406edde765858751ec6ebe"} Jun 08 13:12:55.513140 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.512822 2573 scope.go:117] "RemoveContainer" containerID="65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088" Jun 08 13:12:55.521894 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.521878 2573 scope.go:117] "RemoveContainer" containerID="65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088" Jun 08 13:12:55.522171 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:12:55.522148 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088\": container with ID starting with 65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088 not found: ID does not exist" containerID="65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088" Jun 08 13:12:55.522268 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.522175 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088"} err="failed to get container status \"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088\": rpc error: code = NotFound desc = could not find container \"65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088\": container with ID starting with 65f416700aa83ee3db91f4f67a7b25934b18a75c3918ae7b95ba4e6a2db8b088 not found: ID does not exist" Jun 08 13:12:55.543021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.542985 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:55.545024 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.545002 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cm42n"] Jun 08 13:12:55.695449 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:12:55.695410 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496055de-625b-4105-9cd7-896d6a15a15d" path="/var/lib/kubelet/pods/496055de-625b-4105-9cd7-896d6a15a15d/volumes" Jun 08 13:13:01.734201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:01.734170 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:13:01.734652 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:01.734224 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:13:01.755713 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:01.755689 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:13:02.568154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:02.568128 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-c4srh" Jun 08 13:13:25.378096 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.378058 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g"] Jun 08 13:13:25.378553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.378424 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496055de-625b-4105-9cd7-896d6a15a15d" containerName="registry-server" Jun 08 13:13:25.378553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.378434 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="496055de-625b-4105-9cd7-896d6a15a15d" containerName="registry-server" Jun 08 13:13:25.378553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.378501 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="496055de-625b-4105-9cd7-896d6a15a15d" containerName="registry-server" Jun 08 13:13:25.381472 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.381444 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.384719 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.384699 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-srkxc\"" Jun 08 13:13:25.417745 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.417708 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g"] Jun 08 13:13:25.489856 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.489811 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.490073 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.489872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthmx\" (UniqueName: \"kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.590824 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.590787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.591017 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.590845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthmx\" (UniqueName: \"kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.591266 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.591240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.604461 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.604435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthmx\" (UniqueName: \"kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.691503 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.691475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:25.842586 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:25.842538 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g"] Jun 08 13:13:25.844929 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:25.844900 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b69c26e_2571_4533_ac5d_ef27a2808305.slice/crio-bf4125b401d79b92eeb455ea9593b3804d173ec3e3b7743cf573eef83003a7de WatchSource:0}: Error finding container bf4125b401d79b92eeb455ea9593b3804d173ec3e3b7743cf573eef83003a7de: Status 404 returned error can't find the container with id bf4125b401d79b92eeb455ea9593b3804d173ec3e3b7743cf573eef83003a7de Jun 08 13:13:26.657563 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:26.657520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" event={"ID":"3b69c26e-2571-4533-ac5d-ef27a2808305","Type":"ContainerStarted","Data":"bf4125b401d79b92eeb455ea9593b3804d173ec3e3b7743cf573eef83003a7de"} Jun 08 13:13:30.112285 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.112252 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm"] Jun 08 13:13:30.115922 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.115904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:30.119653 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.119630 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 08 13:13:30.119757 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.119695 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rd8nv\"" Jun 08 13:13:30.132719 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.132693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwtl\" (UniqueName: \"kubernetes.io/projected/2560e285-8665-40ed-877c-72ed9bcc774b-kube-api-access-fvwtl\") pod \"dns-operator-controller-manager-864dd78c4c-fwvkm\" (UID: \"2560e285-8665-40ed-877c-72ed9bcc774b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:30.140467 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.140446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm"] Jun 08 13:13:30.234121 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.234090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwtl\" (UniqueName: \"kubernetes.io/projected/2560e285-8665-40ed-877c-72ed9bcc774b-kube-api-access-fvwtl\") pod \"dns-operator-controller-manager-864dd78c4c-fwvkm\" (UID: \"2560e285-8665-40ed-877c-72ed9bcc774b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:30.246539 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.246509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwtl\" (UniqueName: \"kubernetes.io/projected/2560e285-8665-40ed-877c-72ed9bcc774b-kube-api-access-fvwtl\") pod \"dns-operator-controller-manager-864dd78c4c-fwvkm\" (UID: \"2560e285-8665-40ed-877c-72ed9bcc774b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:30.426904 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.426875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:30.582927 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.582902 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm"] Jun 08 13:13:30.585833 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:30.585803 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2560e285_8665_40ed_877c_72ed9bcc774b.slice/crio-b0441a64cb2fd03d89ad850d563b4784619fced4db277ff347785dbbf126e0a7 WatchSource:0}: Error finding container b0441a64cb2fd03d89ad850d563b4784619fced4db277ff347785dbbf126e0a7: Status 404 returned error can't find the container with id b0441a64cb2fd03d89ad850d563b4784619fced4db277ff347785dbbf126e0a7 Jun 08 13:13:30.681054 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:30.680944 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" event={"ID":"2560e285-8665-40ed-877c-72ed9bcc774b","Type":"ContainerStarted","Data":"b0441a64cb2fd03d89ad850d563b4784619fced4db277ff347785dbbf126e0a7"} Jun 08 13:13:32.693910 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:32.693877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" event={"ID":"3b69c26e-2571-4533-ac5d-ef27a2808305","Type":"ContainerStarted","Data":"3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4"} Jun 08 13:13:32.694332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:32.693949 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:32.722006 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:32.721954 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" podStartSLOduration=1.523099043 podStartE2EDuration="7.721937598s" totalImagesPullingTime="6.198838555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:32.719843065 +0000 UTC m=+751.467893047" watchObservedRunningTime="2026-06-08 13:13:32.721937598 +0000 UTC m=+751.469987578" Jun 08 13:13:33.016901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.016810 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995"] Jun 08 13:13:33.020722 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.020696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:33.026666 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.026644 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cssbb\"" Jun 08 13:13:33.043640 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.043614 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995"] Jun 08 13:13:33.060400 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.060367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dphmr\" (UniqueName: \"kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr\") pod \"limitador-operator-controller-manager-859d7b78bd-v4995\" (UID: \"1519aa3c-6032-439b-b1fc-45120e9666e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:33.161623 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.161587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dphmr\" (UniqueName: \"kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr\") pod \"limitador-operator-controller-manager-859d7b78bd-v4995\" (UID: \"1519aa3c-6032-439b-b1fc-45120e9666e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:33.180914 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.180892 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dphmr\" (UniqueName: \"kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr\") pod \"limitador-operator-controller-manager-859d7b78bd-v4995\" (UID: \"1519aa3c-6032-439b-b1fc-45120e9666e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:33.332663 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.332567 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:33.483796 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.483769 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995"] Jun 08 13:13:33.485782 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:33.485754 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1519aa3c_6032_439b_b1fc_45120e9666e4.slice/crio-1de762a2164438693fe80048c2ea89ffe55620714fed7b8b9e426289331cf689 WatchSource:0}: Error finding container 1de762a2164438693fe80048c2ea89ffe55620714fed7b8b9e426289331cf689: Status 404 returned error can't find the container with id 1de762a2164438693fe80048c2ea89ffe55620714fed7b8b9e426289331cf689 Jun 08 13:13:33.700370 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:33.700335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" event={"ID":"1519aa3c-6032-439b-b1fc-45120e9666e4","Type":"ContainerStarted","Data":"1de762a2164438693fe80048c2ea89ffe55620714fed7b8b9e426289331cf689"} Jun 08 13:13:34.708370 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:34.708332 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" event={"ID":"2560e285-8665-40ed-877c-72ed9bcc774b","Type":"ContainerStarted","Data":"0a6e68b688b2a1000fce4166f7585ae54f432163a6eafeb9c364c79c49fc4b67"} Jun 08 13:13:34.708840 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:34.708579 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:34.767341 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:34.767286 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" podStartSLOduration=1.466718666 podStartE2EDuration="4.767268717s" totalImagesPullingTime="3.300550051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:34.765175393 +0000 UTC m=+753.513225374" watchObservedRunningTime="2026-06-08 13:13:34.767268717 +0000 UTC m=+753.515318781" Jun 08 13:13:35.714950 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:35.714903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" event={"ID":"1519aa3c-6032-439b-b1fc-45120e9666e4","Type":"ContainerStarted","Data":"f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc"} Jun 08 13:13:35.715357 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:35.714991 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:35.764587 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:35.764532 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" podStartSLOduration=2.166682052 podStartE2EDuration="3.764516965s" totalImagesPullingTime="1.597834913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:35.762160878 +0000 UTC m=+754.510210859" watchObservedRunningTime="2026-06-08 13:13:35.764516965 +0000 UTC m=+754.512566946" Jun 08 13:13:43.703014 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:43.702981 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:45.717949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.717917 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwvkm" Jun 08 13:13:45.823246 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.823212 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g"] Jun 08 13:13:45.823472 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.823444 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" containerName="manager" containerID="cri-o://3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4" gracePeriod=2 Jun 08 13:13:45.850736 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.850707 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g"] Jun 08 13:13:45.855801 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.855757 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b69c26e-2571-4533-ac5d-ef27a2808305\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\": pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:45.869528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.869499 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995"] Jun 08 13:13:45.869740 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.869714 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" containerName="manager" containerID="cri-o://f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc" gracePeriod=2 Jun 08 13:13:45.871565 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.871520 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:45.873235 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.873203 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:45.889270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.889239 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995"] Jun 08 13:13:45.899355 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.899323 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1519aa3c-6032-439b-b1fc-45120e9666e4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-v4995\": pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:45.901759 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.901728 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:45.904580 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.904549 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:45.906352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906329 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr"] Jun 08 13:13:45.906779 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906760 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" containerName="manager" Jun 08 13:13:45.906779 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906777 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" containerName="manager" Jun 08 13:13:45.906904 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906827 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" containerName="manager" Jun 08 13:13:45.906904 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906837 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" containerName="manager" Jun 08 13:13:45.906967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906927 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" containerName="manager" Jun 08 13:13:45.906967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.906938 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" containerName="manager" Jun 08 13:13:45.917731 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.917702 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:45.927234 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.927204 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:13:45.930558 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.930538 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:45.937064 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.937022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr"] Jun 08 13:13:45.963170 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.963134 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:13:45.964697 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.964489 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:45.967114 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:45.967084 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:45.981640 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.981602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:45.981834 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.981763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt7hm\" (UniqueName: \"kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:45.981890 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:45.981878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwjb7\" (UniqueName: \"kubernetes.io/projected/1407d881-4f65-4b9d-9f7f-14859ee494b1-kube-api-access-cwjb7\") pod \"limitador-operator-controller-manager-859d7b78bd-tfmkr\" (UID: \"1407d881-4f65-4b9d-9f7f-14859ee494b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:46.025350 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.025310 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.028100 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.028073 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.082928 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.082879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwjb7\" (UniqueName: \"kubernetes.io/projected/1407d881-4f65-4b9d-9f7f-14859ee494b1-kube-api-access-cwjb7\") pod \"limitador-operator-controller-manager-859d7b78bd-tfmkr\" (UID: \"1407d881-4f65-4b9d-9f7f-14859ee494b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:46.082928 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.082931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.083235 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.083014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt7hm\" (UniqueName: \"kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.083416 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.083396 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.097800 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.097769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwjb7\" (UniqueName: \"kubernetes.io/projected/1407d881-4f65-4b9d-9f7f-14859ee494b1-kube-api-access-cwjb7\") pod \"limitador-operator-controller-manager-859d7b78bd-tfmkr\" (UID: \"1407d881-4f65-4b9d-9f7f-14859ee494b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:46.101979 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.101951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt7hm\" (UniqueName: \"kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-94pw5\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.128611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.128585 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.130636 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.130614 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.134708 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.134682 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.140916 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.140888 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.143195 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.143173 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.145558 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.145530 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.183916 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.183876 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rthmx\" (UniqueName: \"kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx\") pod \"3b69c26e-2571-4533-ac5d-ef27a2808305\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " Jun 08 13:13:46.184133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.183925 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume\") pod \"3b69c26e-2571-4533-ac5d-ef27a2808305\" (UID: \"3b69c26e-2571-4533-ac5d-ef27a2808305\") " Jun 08 13:13:46.184133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.183969 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dphmr\" (UniqueName: \"kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr\") pod \"1519aa3c-6032-439b-b1fc-45120e9666e4\" (UID: \"1519aa3c-6032-439b-b1fc-45120e9666e4\") " Jun 08 13:13:46.184492 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.184459 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b69c26e-2571-4533-ac5d-ef27a2808305" (UID: "3b69c26e-2571-4533-ac5d-ef27a2808305"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:46.185967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.185948 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr" (OuterVolumeSpecName: "kube-api-access-dphmr") pod "1519aa3c-6032-439b-b1fc-45120e9666e4" (UID: "1519aa3c-6032-439b-b1fc-45120e9666e4"). InnerVolumeSpecName "kube-api-access-dphmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:46.186053 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.185964 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx" (OuterVolumeSpecName: "kube-api-access-rthmx") pod "3b69c26e-2571-4533-ac5d-ef27a2808305" (UID: "3b69c26e-2571-4533-ac5d-ef27a2808305"). InnerVolumeSpecName "kube-api-access-rthmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:46.274317 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.274226 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:46.280352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.280327 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.285814 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.285790 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rthmx\" (UniqueName: \"kubernetes.io/projected/3b69c26e-2571-4533-ac5d-ef27a2808305-kube-api-access-rthmx\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:13:46.285866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.285821 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b69c26e-2571-4533-ac5d-ef27a2808305-extensions-socket-volume\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:13:46.285866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.285836 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dphmr\" (UniqueName: \"kubernetes.io/projected/1519aa3c-6032-439b-b1fc-45120e9666e4-kube-api-access-dphmr\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:13:46.455297 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.455181 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr"] Jun 08 13:13:46.457815 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:46.457747 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1407d881_4f65_4b9d_9f7f_14859ee494b1.slice/crio-aa2f2ede9724c9881b5e550e5df935a17401965eb2b790af8a94e3f59ea5c87f WatchSource:0}: Error finding container aa2f2ede9724c9881b5e550e5df935a17401965eb2b790af8a94e3f59ea5c87f: Status 404 returned error can't find the container with id aa2f2ede9724c9881b5e550e5df935a17401965eb2b790af8a94e3f59ea5c87f Jun 08 13:13:46.472204 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.472176 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:13:46.475008 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:46.474978 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fff524_af9a_4469_b2ef_47aa493048bd.slice/crio-cdeafff75cf8f91a30f0f6ed0bbd181ee3025633051ab293ca9287b2621075f2 WatchSource:0}: Error finding container cdeafff75cf8f91a30f0f6ed0bbd181ee3025633051ab293ca9287b2621075f2: Status 404 returned error can't find the container with id cdeafff75cf8f91a30f0f6ed0bbd181ee3025633051ab293ca9287b2621075f2 Jun 08 13:13:46.769843 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.769802 2573 generic.go:356] "Generic (PLEG): container finished" podID="3b69c26e-2571-4533-ac5d-ef27a2808305" containerID="3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4" exitCode=0 Jun 08 13:13:46.770283 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.769849 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.770283 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.769902 2573 scope.go:117] "RemoveContainer" containerID="3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4" Jun 08 13:13:46.771681 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.771658 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" event={"ID":"f7fff524-af9a-4469-b2ef-47aa493048bd","Type":"ContainerStarted","Data":"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809"} Jun 08 13:13:46.771833 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.771708 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" event={"ID":"f7fff524-af9a-4469-b2ef-47aa493048bd","Type":"ContainerStarted","Data":"cdeafff75cf8f91a30f0f6ed0bbd181ee3025633051ab293ca9287b2621075f2"} Jun 08 13:13:46.771833 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.771752 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:46.773426 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.773404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" event={"ID":"1407d881-4f65-4b9d-9f7f-14859ee494b1","Type":"ContainerStarted","Data":"72c627a8205196d172818b6ab592b66b12b8037c97069cde1b33b2dd9d8a6029"} Jun 08 13:13:46.773510 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.773454 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:13:46.773510 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.773472 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" event={"ID":"1407d881-4f65-4b9d-9f7f-14859ee494b1","Type":"ContainerStarted","Data":"aa2f2ede9724c9881b5e550e5df935a17401965eb2b790af8a94e3f59ea5c87f"} Jun 08 13:13:46.774703 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.774676 2573 generic.go:356] "Generic (PLEG): container finished" podID="1519aa3c-6032-439b-b1fc-45120e9666e4" containerID="f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc" exitCode=0 Jun 08 13:13:46.774809 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.774719 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.777369 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.777346 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:46.779021 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.779000 2573 scope.go:117] "RemoveContainer" containerID="3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4" Jun 08 13:13:46.779284 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.779264 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4\": container with ID starting with 3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4 not found: ID does not exist" containerID="3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4" Jun 08 13:13:46.779350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.779295 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4"} err="failed to get container status \"3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4\": rpc error: code = NotFound desc = could not find container \"3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4\": container with ID starting with 3ddd067ffa293a0ab51272f087f59b0fe1575757d8666971a8097cebd4bed5b4 not found: ID does not exist" Jun 08 13:13:46.779350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.779314 2573 scope.go:117] "RemoveContainer" containerID="f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc" Jun 08 13:13:46.779916 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.779893 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:46.787167 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.787149 2573 scope.go:117] "RemoveContainer" containerID="f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc" Jun 08 13:13:46.787430 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:46.787413 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc\": container with ID starting with f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc not found: ID does not exist" containerID="f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc" Jun 08 13:13:46.787497 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.787435 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc"} err="failed to get container status \"f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc\": rpc error: code = NotFound desc = could not find container \"f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc\": container with ID starting with f88be25dd2f89512c247e4d09a7070c76dd16df6c67e236ad40c531851a6b3cc not found: ID does not exist" Jun 08 13:13:46.933317 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:46.933262 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" podStartSLOduration=1.933242351 podStartE2EDuration="1.933242351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:46.929764237 +0000 UTC m=+765.677814240" watchObservedRunningTime="2026-06-08 13:13:46.933242351 +0000 UTC m=+765.681292333" Jun 08 13:13:47.011098 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:47.011031 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:47.011607 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:47.011569 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" podStartSLOduration=2.011553752 podStartE2EDuration="2.011553752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:47.008671894 +0000 UTC m=+765.756721876" watchObservedRunningTime="2026-06-08 13:13:47.011553752 +0000 UTC m=+765.759603733" Jun 08 13:13:47.014561 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:47.014537 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:47.017133 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:47.017115 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z7p5g\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z7p5g" Jun 08 13:13:47.020811 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:47.020764 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-v4995\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4995" Jun 08 13:13:47.696223 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:47.696190 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1519aa3c-6032-439b-b1fc-45120e9666e4" path="/var/lib/kubelet/pods/1519aa3c-6032-439b-b1fc-45120e9666e4/volumes" Jun 08 13:13:47.696617 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:47.696602 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b69c26e-2571-4533-ac5d-ef27a2808305" path="/var/lib/kubelet/pods/3b69c26e-2571-4533-ac5d-ef27a2808305/volumes" Jun 08 13:13:50.433852 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.433817 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:13:50.438762 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.438739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.446549 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:13:50.446523 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cg925\" is forbidden: User \"system:node:ip-10-0-140-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-115.ec2.internal' and this object" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.524147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.524114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.524286 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.524175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqz9h\" (UniqueName: \"kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.537028 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.536996 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:13:50.625105 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.625076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqz9h\" (UniqueName: \"kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.625273 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.625176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.625545 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.625527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.639325 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.639304 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqz9h\" (UniqueName: \"kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h\") pod \"kuadrant-operator-controller-manager-86878c769f-cg925\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.747975 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.747892 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:50.954202 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:50.954171 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:13:50.958139 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:13:50.958113 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37195358_01c6_473a_b8fa_b81f14c8d2c4.slice/crio-0f33ea2d6aede1cf434baaf9476edf2eb01093241ddca7f5444a012b83a16708 WatchSource:0}: Error finding container 0f33ea2d6aede1cf434baaf9476edf2eb01093241ddca7f5444a012b83a16708: Status 404 returned error can't find the container with id 0f33ea2d6aede1cf434baaf9476edf2eb01093241ddca7f5444a012b83a16708 Jun 08 13:13:51.804537 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:51.804493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" event={"ID":"37195358-01c6-473a-b8fa-b81f14c8d2c4","Type":"ContainerStarted","Data":"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e"} Jun 08 13:13:51.804949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:51.804553 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" event={"ID":"37195358-01c6-473a-b8fa-b81f14c8d2c4","Type":"ContainerStarted","Data":"0f33ea2d6aede1cf434baaf9476edf2eb01093241ddca7f5444a012b83a16708"} Jun 08 13:13:51.804949 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:51.804575 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:13:51.838744 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:51.838683 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" podStartSLOduration=1.838666272 podStartE2EDuration="1.838666272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:51.836889337 +0000 UTC m=+770.584939342" watchObservedRunningTime="2026-06-08 13:13:51.838666272 +0000 UTC m=+770.586716253" Jun 08 13:13:57.783815 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:57.783785 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:13:57.784329 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:13:57.783893 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tfmkr" Jun 08 13:14:02.812599 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:02.812571 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:14:02.894391 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:02.894350 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:14:02.894618 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:02.894593 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" podUID="f7fff524-af9a-4469-b2ef-47aa493048bd" containerName="manager" containerID="cri-o://98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809" gracePeriod=10 Jun 08 13:14:03.149123 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.149096 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:14:03.239162 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.239128 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume\") pod \"f7fff524-af9a-4469-b2ef-47aa493048bd\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " Jun 08 13:14:03.239357 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.239194 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt7hm\" (UniqueName: \"kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm\") pod \"f7fff524-af9a-4469-b2ef-47aa493048bd\" (UID: \"f7fff524-af9a-4469-b2ef-47aa493048bd\") " Jun 08 13:14:03.239573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.239546 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7fff524-af9a-4469-b2ef-47aa493048bd" (UID: "f7fff524-af9a-4469-b2ef-47aa493048bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:14:03.241355 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.241324 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm" (OuterVolumeSpecName: "kube-api-access-bt7hm") pod "f7fff524-af9a-4469-b2ef-47aa493048bd" (UID: "f7fff524-af9a-4469-b2ef-47aa493048bd"). InnerVolumeSpecName "kube-api-access-bt7hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:14:03.340305 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.340222 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7fff524-af9a-4469-b2ef-47aa493048bd-extensions-socket-volume\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:14:03.340305 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.340252 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt7hm\" (UniqueName: \"kubernetes.io/projected/f7fff524-af9a-4469-b2ef-47aa493048bd-kube-api-access-bt7hm\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:14:03.863759 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.863723 2573 generic.go:356] "Generic (PLEG): container finished" podID="f7fff524-af9a-4469-b2ef-47aa493048bd" containerID="98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809" exitCode=0 Jun 08 13:14:03.864219 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.863781 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" Jun 08 13:14:03.864219 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.863807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" event={"ID":"f7fff524-af9a-4469-b2ef-47aa493048bd","Type":"ContainerDied","Data":"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809"} Jun 08 13:14:03.864219 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.863860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5" event={"ID":"f7fff524-af9a-4469-b2ef-47aa493048bd","Type":"ContainerDied","Data":"cdeafff75cf8f91a30f0f6ed0bbd181ee3025633051ab293ca9287b2621075f2"} Jun 08 13:14:03.864219 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.863886 2573 scope.go:117] "RemoveContainer" containerID="98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809" Jun 08 13:14:03.872779 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.872755 2573 scope.go:117] "RemoveContainer" containerID="98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809" Jun 08 13:14:03.873084 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:14:03.873064 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809\": container with ID starting with 98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809 not found: ID does not exist" containerID="98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809" Jun 08 13:14:03.873148 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.873095 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809"} err="failed to get container status \"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809\": rpc error: code = NotFound desc = could not find container \"98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809\": container with ID starting with 98777df7addeaa15cc91847a0f3119f1b85a5b79d8aff4449817a648d65ad809 not found: ID does not exist" Jun 08 13:14:03.894377 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.894337 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:14:03.895948 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:03.895926 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-94pw5"] Jun 08 13:14:05.695659 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:05.695630 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7fff524-af9a-4469-b2ef-47aa493048bd" path="/var/lib/kubelet/pods/f7fff524-af9a-4469-b2ef-47aa493048bd/volumes" Jun 08 13:14:19.354387 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.354355 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47"] Jun 08 13:14:19.354727 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.354714 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7fff524-af9a-4469-b2ef-47aa493048bd" containerName="manager" Jun 08 13:14:19.354727 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.354724 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7fff524-af9a-4469-b2ef-47aa493048bd" containerName="manager" Jun 08 13:14:19.354806 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.354795 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7fff524-af9a-4469-b2ef-47aa493048bd" containerName="manager" Jun 08 13:14:19.359218 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.359199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.361904 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.361885 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5ghb4\"" Jun 08 13:14:19.379064 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.379018 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47"] Jun 08 13:14:19.382345 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382444 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382444 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmc9\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-kube-api-access-hdmc9\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382670 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382670 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382670 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.382803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.382708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483769 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.483967 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.483951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmc9\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-kube-api-access-hdmc9\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484468 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484468 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484571 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.484611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.484580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.486197 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.486171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.486314 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.486300 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.503642 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.503622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.505453 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.505435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmc9\" (UniqueName: \"kubernetes.io/projected/7249bbb1-915d-4981-8f42-2bd17c8d55d3-kube-api-access-hdmc9\") pod \"maas-default-gateway-openshift-default-8559cd5744-gcv47\" (UID: \"7249bbb1-915d-4981-8f42-2bd17c8d55d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.668944 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.668910 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:19.821884 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.821849 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47"] Jun 08 13:14:19.826714 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:14:19.826683 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7249bbb1_915d_4981_8f42_2bd17c8d55d3.slice/crio-c5f2f14cd2da3841dffd6ee465904845e1682a974b1549a18fcbc76c42b7f5d6 WatchSource:0}: Error finding container c5f2f14cd2da3841dffd6ee465904845e1682a974b1549a18fcbc76c42b7f5d6: Status 404 returned error can't find the container with id c5f2f14cd2da3841dffd6ee465904845e1682a974b1549a18fcbc76c42b7f5d6 Jun 08 13:14:19.828722 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.828694 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:14:19.828794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.828756 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:14:19.828794 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.828785 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:14:19.942579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.942497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" event={"ID":"7249bbb1-915d-4981-8f42-2bd17c8d55d3","Type":"ContainerStarted","Data":"387c7552658192d87f71062142de046910b80476884eb94982155ec2b95ba072"} Jun 08 13:14:19.942579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.942559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" event={"ID":"7249bbb1-915d-4981-8f42-2bd17c8d55d3","Type":"ContainerStarted","Data":"c5f2f14cd2da3841dffd6ee465904845e1682a974b1549a18fcbc76c42b7f5d6"} Jun 08 13:14:19.970809 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:19.970763 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" podStartSLOduration=0.970745037 podStartE2EDuration="970.745037ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:19.968573864 +0000 UTC m=+798.716623842" watchObservedRunningTime="2026-06-08 13:14:19.970745037 +0000 UTC m=+798.718795020" Jun 08 13:14:20.669507 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:20.669470 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:20.674421 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:20.674391 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:20.947806 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:20.947725 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:20.948642 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:20.948623 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:14:24.402955 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.402923 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:24.406220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.406201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:24.409542 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.409516 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-td5zj\"" Jun 08 13:14:24.417889 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.417867 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:24.527528 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.527492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb9qh\" (UniqueName: \"kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh\") pod \"authorino-58cd955675-p6x5l\" (UID: \"796fa999-814e-4d73-ac99-24d26f3ab2a7\") " pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:24.628129 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.628096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb9qh\" (UniqueName: \"kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh\") pod \"authorino-58cd955675-p6x5l\" (UID: \"796fa999-814e-4d73-ac99-24d26f3ab2a7\") " pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:24.638642 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.638614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb9qh\" (UniqueName: \"kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh\") pod \"authorino-58cd955675-p6x5l\" (UID: \"796fa999-814e-4d73-ac99-24d26f3ab2a7\") " pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:24.717100 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.717011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:24.853071 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.853027 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:24.854780 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:14:24.854754 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod796fa999_814e_4d73_ac99_24d26f3ab2a7.slice/crio-c3ba6d649d252f538b7f5e2a5e32ca4918e19ad82f9fd1262c82f643bac9a8c1 WatchSource:0}: Error finding container c3ba6d649d252f538b7f5e2a5e32ca4918e19ad82f9fd1262c82f643bac9a8c1: Status 404 returned error can't find the container with id c3ba6d649d252f538b7f5e2a5e32ca4918e19ad82f9fd1262c82f643bac9a8c1 Jun 08 13:14:24.967350 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:24.967267 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p6x5l" event={"ID":"796fa999-814e-4d73-ac99-24d26f3ab2a7","Type":"ContainerStarted","Data":"c3ba6d649d252f538b7f5e2a5e32ca4918e19ad82f9fd1262c82f643bac9a8c1"} Jun 08 13:14:28.991752 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:28.991712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p6x5l" event={"ID":"796fa999-814e-4d73-ac99-24d26f3ab2a7","Type":"ContainerStarted","Data":"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c"} Jun 08 13:14:29.019633 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:29.019585 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-p6x5l" podStartSLOduration=1.886570997 podStartE2EDuration="5.019570718s" totalImagesPullingTime="3.132999721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:29.018689413 +0000 UTC m=+807.766739395" watchObservedRunningTime="2026-06-08 13:14:29.019570718 +0000 UTC m=+807.767620700" Jun 08 13:14:29.961502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:29.961467 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:31.006399 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:31.006352 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-p6x5l" podUID="796fa999-814e-4d73-ac99-24d26f3ab2a7" containerName="authorino" containerID="cri-o://5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c" gracePeriod=30 Jun 08 13:14:31.252541 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:31.252517 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:31.292237 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:31.292164 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb9qh\" (UniqueName: \"kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh\") pod \"796fa999-814e-4d73-ac99-24d26f3ab2a7\" (UID: \"796fa999-814e-4d73-ac99-24d26f3ab2a7\") " Jun 08 13:14:31.294136 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:31.294109 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh" (OuterVolumeSpecName: "kube-api-access-hb9qh") pod "796fa999-814e-4d73-ac99-24d26f3ab2a7" (UID: "796fa999-814e-4d73-ac99-24d26f3ab2a7"). InnerVolumeSpecName "kube-api-access-hb9qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:14:31.393552 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:31.393520 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb9qh\" (UniqueName: \"kubernetes.io/projected/796fa999-814e-4d73-ac99-24d26f3ab2a7-kube-api-access-hb9qh\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:14:32.018314 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.018209 2573 generic.go:356] "Generic (PLEG): container finished" podID="796fa999-814e-4d73-ac99-24d26f3ab2a7" containerID="5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c" exitCode=0 Jun 08 13:14:32.018314 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.018265 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p6x5l" Jun 08 13:14:32.018767 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.018301 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p6x5l" event={"ID":"796fa999-814e-4d73-ac99-24d26f3ab2a7","Type":"ContainerDied","Data":"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c"} Jun 08 13:14:32.018767 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.018359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p6x5l" event={"ID":"796fa999-814e-4d73-ac99-24d26f3ab2a7","Type":"ContainerDied","Data":"c3ba6d649d252f538b7f5e2a5e32ca4918e19ad82f9fd1262c82f643bac9a8c1"} Jun 08 13:14:32.018767 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.018378 2573 scope.go:117] "RemoveContainer" containerID="5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c" Jun 08 13:14:32.026954 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.026937 2573 scope.go:117] "RemoveContainer" containerID="5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c" Jun 08 13:14:32.027213 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:14:32.027192 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c\": container with ID starting with 5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c not found: ID does not exist" containerID="5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c" Jun 08 13:14:32.027291 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.027219 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c"} err="failed to get container status \"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c\": rpc error: code = NotFound desc = could not find container \"5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c\": container with ID starting with 5a6c8c3c23c9f138660fdfd27b8e5ba913db9a709b76c2e2bff5b67f81ef769c not found: ID does not exist" Jun 08 13:14:32.041090 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.041069 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:32.054256 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:32.054237 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-p6x5l"] Jun 08 13:14:33.695577 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:14:33.695545 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="796fa999-814e-4d73-ac99-24d26f3ab2a7" path="/var/lib/kubelet/pods/796fa999-814e-4d73-ac99-24d26f3ab2a7/volumes" Jun 08 13:15:04.295410 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.295371 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-98bpj"] Jun 08 13:15:04.295826 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.295746 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="796fa999-814e-4d73-ac99-24d26f3ab2a7" containerName="authorino" Jun 08 13:15:04.295826 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.295757 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="796fa999-814e-4d73-ac99-24d26f3ab2a7" containerName="authorino" Jun 08 13:15:04.295826 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.295811 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="796fa999-814e-4d73-ac99-24d26f3ab2a7" containerName="authorino" Jun 08 13:15:04.300154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.300136 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" Jun 08 13:15:04.304858 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.304837 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:15:04.305711 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.305688 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-rkwzg\"" Jun 08 13:15:04.305838 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.305715 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:15:04.331657 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.331627 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-98bpj"] Jun 08 13:15:04.387708 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.387676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlx54\" (UniqueName: \"kubernetes.io/projected/45fda75e-897e-4db4-a393-d36509116b4e-kube-api-access-wlx54\") pod \"keycloak-operator-d67dbbb48-98bpj\" (UID: \"45fda75e-897e-4db4-a393-d36509116b4e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" Jun 08 13:15:04.488566 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.488532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlx54\" (UniqueName: \"kubernetes.io/projected/45fda75e-897e-4db4-a393-d36509116b4e-kube-api-access-wlx54\") pod \"keycloak-operator-d67dbbb48-98bpj\" (UID: \"45fda75e-897e-4db4-a393-d36509116b4e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" Jun 08 13:15:04.515010 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.514982 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlx54\" (UniqueName: \"kubernetes.io/projected/45fda75e-897e-4db4-a393-d36509116b4e-kube-api-access-wlx54\") pod \"keycloak-operator-d67dbbb48-98bpj\" (UID: \"45fda75e-897e-4db4-a393-d36509116b4e\") " pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" Jun 08 13:15:04.610959 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.610876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" Jun 08 13:15:04.744613 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:04.744506 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-98bpj"] Jun 08 13:15:04.747278 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:15:04.747250 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fda75e_897e_4db4_a393_d36509116b4e.slice/crio-b5100f9a0cb0ff1edaddb28cb656f8883199d57819e037dfc5affb09e582e520 WatchSource:0}: Error finding container b5100f9a0cb0ff1edaddb28cb656f8883199d57819e037dfc5affb09e582e520: Status 404 returned error can't find the container with id b5100f9a0cb0ff1edaddb28cb656f8883199d57819e037dfc5affb09e582e520 Jun 08 13:15:05.188371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:05.188338 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" event={"ID":"45fda75e-897e-4db4-a393-d36509116b4e","Type":"ContainerStarted","Data":"b5100f9a0cb0ff1edaddb28cb656f8883199d57819e037dfc5affb09e582e520"} Jun 08 13:15:11.228092 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:11.228060 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" event={"ID":"45fda75e-897e-4db4-a393-d36509116b4e","Type":"ContainerStarted","Data":"abdc689e19c43f7db26f3fdf80f0f5734a713dbd2688b6a5005ddfd4106f3f32"} Jun 08 13:15:11.255703 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:11.255642 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-98bpj" podStartSLOduration=1.669816296 podStartE2EDuration="7.255624318s" totalImagesPullingTime="5.585808022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:15:11.253128536 +0000 UTC m=+850.001178518" watchObservedRunningTime="2026-06-08 13:15:11.255624318 +0000 UTC m=+850.003674299" Jun 08 13:15:55.080027 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.079950 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:15:55.083994 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.083969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.088054 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.087953 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rnh8q\"" Jun 08 13:15:55.089069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.088406 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:15:55.089069 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.088800 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:15:55.095950 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.095922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:15:55.150059 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.150004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f46q\" (UniqueName: \"kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.150222 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.150069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.251272 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.251238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f46q\" (UniqueName: \"kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.251434 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.251299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.253180 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.253144 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:15:55.253683 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.253661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.255974 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.255954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.259765 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.259744 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f46q\" (UniqueName: \"kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q\") pod \"maas-controller-7c478b85b-xrkm2\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.271526 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.271506 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:15:55.352133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.352032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.352133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.352106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbf8\" (UniqueName: \"kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.419083 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.419015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:55.452807 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.452777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.452947 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.452818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbf8\" (UniqueName: \"kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.455415 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.455393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.461568 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.461543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbf8\" (UniqueName: \"kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8\") pod \"maas-controller-5c8756c68c-7vpkj\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.550721 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.550689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:15:55.554971 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:15:55.554941 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4103a419_3754_4d2e_9b3a_d0299493f9a3.slice/crio-ee44308dd60411a6c605157ae6f55cc66a664ec757c61e892a688ff55b3ddf16 WatchSource:0}: Error finding container ee44308dd60411a6c605157ae6f55cc66a664ec757c61e892a688ff55b3ddf16: Status 404 returned error can't find the container with id ee44308dd60411a6c605157ae6f55cc66a664ec757c61e892a688ff55b3ddf16 Jun 08 13:15:55.579896 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.579867 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:55.713641 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:55.713611 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:15:55.715495 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:15:55.715467 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc5916b_5cf8_495f_ac07_c7c9415c3422.slice/crio-eae536933e193b6fd0a9bf96c1a50c8dc9c8c5b268ba21641f302ae200265980 WatchSource:0}: Error finding container eae536933e193b6fd0a9bf96c1a50c8dc9c8c5b268ba21641f302ae200265980: Status 404 returned error can't find the container with id eae536933e193b6fd0a9bf96c1a50c8dc9c8c5b268ba21641f302ae200265980 Jun 08 13:15:56.452002 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:56.451963 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" event={"ID":"ebc5916b-5cf8-495f-ac07-c7c9415c3422","Type":"ContainerStarted","Data":"eae536933e193b6fd0a9bf96c1a50c8dc9c8c5b268ba21641f302ae200265980"} Jun 08 13:15:56.454090 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:56.453981 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c478b85b-xrkm2" event={"ID":"4103a419-3754-4d2e-9b3a-d0299493f9a3","Type":"ContainerStarted","Data":"ee44308dd60411a6c605157ae6f55cc66a664ec757c61e892a688ff55b3ddf16"} Jun 08 13:15:58.466724 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.466633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" event={"ID":"ebc5916b-5cf8-495f-ac07-c7c9415c3422","Type":"ContainerStarted","Data":"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8"} Jun 08 13:15:58.467167 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.466806 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:15:58.468187 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.468166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c478b85b-xrkm2" event={"ID":"4103a419-3754-4d2e-9b3a-d0299493f9a3","Type":"ContainerStarted","Data":"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e"} Jun 08 13:15:58.468293 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.468214 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:15:58.493060 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.490758 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" podStartSLOduration=1.051404259 podStartE2EDuration="3.49073988s" totalImagesPullingTime="2.439335621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:15:58.488955884 +0000 UTC m=+897.237005866" watchObservedRunningTime="2026-06-08 13:15:58.49073988 +0000 UTC m=+897.238789863" Jun 08 13:15:58.512627 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:15:58.512577 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c478b85b-xrkm2" podStartSLOduration=0.906653603 podStartE2EDuration="3.512558644s" totalImagesPullingTime="2.605905041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:15:58.511865865 +0000 UTC m=+897.259915857" watchObservedRunningTime="2026-06-08 13:15:58.512558644 +0000 UTC m=+897.260608626" Jun 08 13:16:02.144355 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:02.144332 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:16:02.151027 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:02.146907 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:16:02.151903 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:02.151883 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:16:02.153819 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:02.153799 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:16:09.479867 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.479835 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:16:09.480256 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.479902 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:16:09.571167 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.571135 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:16:09.571396 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.571371 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7c478b85b-xrkm2" podUID="4103a419-3754-4d2e-9b3a-d0299493f9a3" containerName="manager" containerID="cri-o://e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e" gracePeriod=30 Jun 08 13:16:09.825709 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.825684 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:16:09.997289 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.997203 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert\") pod \"4103a419-3754-4d2e-9b3a-d0299493f9a3\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " Jun 08 13:16:09.997436 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.997307 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f46q\" (UniqueName: \"kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q\") pod \"4103a419-3754-4d2e-9b3a-d0299493f9a3\" (UID: \"4103a419-3754-4d2e-9b3a-d0299493f9a3\") " Jun 08 13:16:09.999420 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.999387 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4103a419-3754-4d2e-9b3a-d0299493f9a3" (UID: "4103a419-3754-4d2e-9b3a-d0299493f9a3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:16:09.999547 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:09.999475 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q" (OuterVolumeSpecName: "kube-api-access-9f46q") pod "4103a419-3754-4d2e-9b3a-d0299493f9a3" (UID: "4103a419-3754-4d2e-9b3a-d0299493f9a3"). InnerVolumeSpecName "kube-api-access-9f46q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:16:10.098144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.098115 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4103a419-3754-4d2e-9b3a-d0299493f9a3-webhook-cert\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:16:10.098144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.098140 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f46q\" (UniqueName: \"kubernetes.io/projected/4103a419-3754-4d2e-9b3a-d0299493f9a3-kube-api-access-9f46q\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:16:10.527122 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.527085 2573 generic.go:356] "Generic (PLEG): container finished" podID="4103a419-3754-4d2e-9b3a-d0299493f9a3" containerID="e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e" exitCode=0 Jun 08 13:16:10.527522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.527139 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c478b85b-xrkm2" Jun 08 13:16:10.527522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.527157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c478b85b-xrkm2" event={"ID":"4103a419-3754-4d2e-9b3a-d0299493f9a3","Type":"ContainerDied","Data":"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e"} Jun 08 13:16:10.527522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.527202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c478b85b-xrkm2" event={"ID":"4103a419-3754-4d2e-9b3a-d0299493f9a3","Type":"ContainerDied","Data":"ee44308dd60411a6c605157ae6f55cc66a664ec757c61e892a688ff55b3ddf16"} Jun 08 13:16:10.527522 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.527223 2573 scope.go:117] "RemoveContainer" containerID="e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e" Jun 08 13:16:10.536341 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.536324 2573 scope.go:117] "RemoveContainer" containerID="e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e" Jun 08 13:16:10.536615 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:16:10.536597 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e\": container with ID starting with e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e not found: ID does not exist" containerID="e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e" Jun 08 13:16:10.536679 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.536628 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e"} err="failed to get container status \"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e\": rpc error: code = NotFound desc = could not find container \"e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e\": container with ID starting with e30943b39627535915137b3ec7608ae14f0d56ce8c24b0b2701df28bdc8d3f1e not found: ID does not exist" Jun 08 13:16:10.555855 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.555821 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:16:10.559579 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:10.559558 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c478b85b-xrkm2"] Jun 08 13:16:11.694943 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:11.694913 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4103a419-3754-4d2e-9b3a-d0299493f9a3" path="/var/lib/kubelet/pods/4103a419-3754-4d2e-9b3a-d0299493f9a3/volumes" Jun 08 13:16:40.682502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.682466 2573 generic.go:356] "Generic (PLEG): container finished" podID="7249bbb1-915d-4981-8f42-2bd17c8d55d3" containerID="387c7552658192d87f71062142de046910b80476884eb94982155ec2b95ba072" exitCode=0 Jun 08 13:16:40.682915 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.682539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" event={"ID":"7249bbb1-915d-4981-8f42-2bd17c8d55d3","Type":"ContainerDied","Data":"387c7552658192d87f71062142de046910b80476884eb94982155ec2b95ba072"} Jun 08 13:16:40.683001 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.682984 2573 scope.go:117] "RemoveContainer" containerID="387c7552658192d87f71062142de046910b80476884eb94982155ec2b95ba072" Jun 08 13:16:40.684077 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.684031 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:16:40.684216 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.684125 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:16:40.684216 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:40.684168 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:16:41.694400 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:41.694363 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" event={"ID":"7249bbb1-915d-4981-8f42-2bd17c8d55d3","Type":"ContainerStarted","Data":"af4030ed28973e15d5edce05125f6f17595e83706bb2e56e75f6f3be10693f6d"} Jun 08 13:16:42.669725 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:42.669687 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:16:42.670208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:42.669927 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-gcv47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 08 13:16:42.670208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:42.669969 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" podUID="7249bbb1-915d-4981-8f42-2bd17c8d55d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 08 13:16:43.670209 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:43.670171 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-gcv47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 08 13:16:43.670611 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:43.670226 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" podUID="7249bbb1-915d-4981-8f42-2bd17c8d55d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 08 13:16:44.669758 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:44.669713 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-gcv47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jun 08 13:16:44.669972 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:44.669780 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" podUID="7249bbb1-915d-4981-8f42-2bd17c8d55d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jun 08 13:16:45.673096 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:45.673059 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:16:45.673510 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:45.673488 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:16:45.674142 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:16:45.674122 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-gcv47" Jun 08 13:19:47.615845 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.615812 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c8b79977-f7f8d"] Jun 08 13:19:47.616323 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.616273 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4103a419-3754-4d2e-9b3a-d0299493f9a3" containerName="manager" Jun 08 13:19:47.616323 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.616289 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4103a419-3754-4d2e-9b3a-d0299493f9a3" containerName="manager" Jun 08 13:19:47.616406 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.616357 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4103a419-3754-4d2e-9b3a-d0299493f9a3" containerName="manager" Jun 08 13:19:47.619419 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.619400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.623009 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.622987 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-td5zj\"" Jun 08 13:19:47.623979 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.623963 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 13:19:47.624159 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.624144 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 13:19:47.646761 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.646734 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c8b79977-f7f8d"] Jun 08 13:19:47.708811 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.708779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjd5\" (UniqueName: \"kubernetes.io/projected/5ce5f505-4462-4e49-b657-69dda0e7c189-kube-api-access-kmjd5\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.708811 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.708818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ce5f505-4462-4e49-b657-69dda0e7c189-tls-cert\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.709020 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.708839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ce5f505-4462-4e49-b657-69dda0e7c189-oidc-ca\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.810226 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.810192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjd5\" (UniqueName: \"kubernetes.io/projected/5ce5f505-4462-4e49-b657-69dda0e7c189-kube-api-access-kmjd5\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.810425 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.810231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ce5f505-4462-4e49-b657-69dda0e7c189-tls-cert\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.810425 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.810250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ce5f505-4462-4e49-b657-69dda0e7c189-oidc-ca\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.810806 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.810787 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5ce5f505-4462-4e49-b657-69dda0e7c189-oidc-ca\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.812418 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.812394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5ce5f505-4462-4e49-b657-69dda0e7c189-tls-cert\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.819241 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.819217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjd5\" (UniqueName: \"kubernetes.io/projected/5ce5f505-4462-4e49-b657-69dda0e7c189-kube-api-access-kmjd5\") pod \"authorino-6c8b79977-f7f8d\" (UID: \"5ce5f505-4462-4e49-b657-69dda0e7c189\") " pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:47.929751 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:47.929704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c8b79977-f7f8d" Jun 08 13:19:48.079199 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:48.079173 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c8b79977-f7f8d"] Jun 08 13:19:48.081529 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:19:48.081501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ce5f505_4462_4e49_b657_69dda0e7c189.slice/crio-0e2207d3b893a879cdfd402f6a6cdae7b41a1ce73cd156f4699dd39918f4d0b5 WatchSource:0}: Error finding container 0e2207d3b893a879cdfd402f6a6cdae7b41a1ce73cd156f4699dd39918f4d0b5: Status 404 returned error can't find the container with id 0e2207d3b893a879cdfd402f6a6cdae7b41a1ce73cd156f4699dd39918f4d0b5 Jun 08 13:19:48.082791 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:48.082774 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:19:48.629865 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:48.629827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c8b79977-f7f8d" event={"ID":"5ce5f505-4462-4e49-b657-69dda0e7c189","Type":"ContainerStarted","Data":"5c74d0d1f882aec63ccaeb12b0ae80bc82bf1dc542ee8ecb121b3ba966b9bc0f"} Jun 08 13:19:48.630301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:48.629878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c8b79977-f7f8d" event={"ID":"5ce5f505-4462-4e49-b657-69dda0e7c189","Type":"ContainerStarted","Data":"0e2207d3b893a879cdfd402f6a6cdae7b41a1ce73cd156f4699dd39918f4d0b5"} Jun 08 13:19:48.660580 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:19:48.660521 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c8b79977-f7f8d" podStartSLOduration=1.234614478 podStartE2EDuration="1.660502673s" totalImagesPullingTime="425.888195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:19:48.65867394 +0000 UTC m=+1127.406723923" watchObservedRunningTime="2026-06-08 13:19:48.660502673 +0000 UTC m=+1127.408552654" Jun 08 13:21:02.179837 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:02.179805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:21:02.183381 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:02.183358 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:21:02.186529 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:02.186509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:21:02.189787 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:02.189771 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:21:28.740233 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:28.740193 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:21:28.740816 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:28.740428 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" podUID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" containerName="manager" containerID="cri-o://4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8" gracePeriod=30 Jun 08 13:21:28.990655 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:28.990588 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:21:29.066866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.066836 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dbf8\" (UniqueName: \"kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8\") pod \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " Jun 08 13:21:29.067063 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.067014 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert\") pod \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\" (UID: \"ebc5916b-5cf8-495f-ac07-c7c9415c3422\") " Jun 08 13:21:29.068829 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.068795 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8" (OuterVolumeSpecName: "kube-api-access-7dbf8") pod "ebc5916b-5cf8-495f-ac07-c7c9415c3422" (UID: "ebc5916b-5cf8-495f-ac07-c7c9415c3422"). InnerVolumeSpecName "kube-api-access-7dbf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:21:29.068948 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.068906 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ebc5916b-5cf8-495f-ac07-c7c9415c3422" (UID: "ebc5916b-5cf8-495f-ac07-c7c9415c3422"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:21:29.137177 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.137146 2573 generic.go:356] "Generic (PLEG): container finished" podID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" containerID="4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8" exitCode=0 Jun 08 13:21:29.137347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.137190 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" Jun 08 13:21:29.137347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.137239 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" event={"ID":"ebc5916b-5cf8-495f-ac07-c7c9415c3422","Type":"ContainerDied","Data":"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8"} Jun 08 13:21:29.137347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.137297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-7vpkj" event={"ID":"ebc5916b-5cf8-495f-ac07-c7c9415c3422","Type":"ContainerDied","Data":"eae536933e193b6fd0a9bf96c1a50c8dc9c8c5b268ba21641f302ae200265980"} Jun 08 13:21:29.137347 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.137323 2573 scope.go:117] "RemoveContainer" containerID="4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8" Jun 08 13:21:29.146323 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.146305 2573 scope.go:117] "RemoveContainer" containerID="4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8" Jun 08 13:21:29.146608 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:21:29.146592 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8\": container with ID starting with 4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8 not found: ID does not exist" containerID="4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8" Jun 08 13:21:29.146673 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.146613 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8"} err="failed to get container status \"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8\": rpc error: code = NotFound desc = could not find container \"4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8\": container with ID starting with 4cf98e5fdc97e5e9f8d914b7686193a4af8eaa2a861682c4bc4dd78f7ab32ce8 not found: ID does not exist" Jun 08 13:21:29.160284 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.160237 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:21:29.162613 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.162581 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-7vpkj"] Jun 08 13:21:29.168229 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.168210 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebc5916b-5cf8-495f-ac07-c7c9415c3422-webhook-cert\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:21:29.168308 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.168232 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dbf8\" (UniqueName: \"kubernetes.io/projected/ebc5916b-5cf8-495f-ac07-c7c9415c3422-kube-api-access-7dbf8\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:21:29.695539 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.695503 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" path="/var/lib/kubelet/pods/ebc5916b-5cf8-495f-ac07-c7c9415c3422/volumes" Jun 08 13:21:29.996880 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.996802 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8756c68c-vsmn6"] Jun 08 13:21:29.997255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.997194 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" containerName="manager" Jun 08 13:21:29.997255 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.997205 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" containerName="manager" Jun 08 13:21:29.997326 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:29.997270 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc5916b-5cf8-495f-ac07-c7c9415c3422" containerName="manager" Jun 08 13:21:30.001652 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.001633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.005760 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.005737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rnh8q\"" Jun 08 13:21:30.005760 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.005752 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:21:30.005925 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.005752 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:21:30.012054 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.012013 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-vsmn6"] Jun 08 13:21:30.076208 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.076175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e832df17-4b68-4c05-9487-21254e486bb5-webhook-cert\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.076384 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.076246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kwln\" (UniqueName: \"kubernetes.io/projected/e832df17-4b68-4c05-9487-21254e486bb5-kube-api-access-7kwln\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.177337 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.177300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e832df17-4b68-4c05-9487-21254e486bb5-webhook-cert\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.177527 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.177364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kwln\" (UniqueName: \"kubernetes.io/projected/e832df17-4b68-4c05-9487-21254e486bb5-kube-api-access-7kwln\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.179751 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.179721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e832df17-4b68-4c05-9487-21254e486bb5-webhook-cert\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.187154 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.187129 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kwln\" (UniqueName: \"kubernetes.io/projected/e832df17-4b68-4c05-9487-21254e486bb5-kube-api-access-7kwln\") pod \"maas-controller-5c8756c68c-vsmn6\" (UID: \"e832df17-4b68-4c05-9487-21254e486bb5\") " pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.313164 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.313065 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:30.451727 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:30.451704 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8756c68c-vsmn6"] Jun 08 13:21:30.453893 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:21:30.453847 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode832df17_4b68_4c05_9487_21254e486bb5.slice/crio-c69c49266c6933d17d4177ff49d1faa290bd346086208beac552411a29535d46 WatchSource:0}: Error finding container c69c49266c6933d17d4177ff49d1faa290bd346086208beac552411a29535d46: Status 404 returned error can't find the container with id c69c49266c6933d17d4177ff49d1faa290bd346086208beac552411a29535d46 Jun 08 13:21:31.149344 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:31.149305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" event={"ID":"e832df17-4b68-4c05-9487-21254e486bb5","Type":"ContainerStarted","Data":"77c756e307416e81d0202aeeab4c784d77b5cde648ca420dc4d157d8bbfb5b77"} Jun 08 13:21:31.149786 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:31.149396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" event={"ID":"e832df17-4b68-4c05-9487-21254e486bb5","Type":"ContainerStarted","Data":"c69c49266c6933d17d4177ff49d1faa290bd346086208beac552411a29535d46"} Jun 08 13:21:31.149786 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:31.149516 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:21:31.172692 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:31.172625 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" podStartSLOduration=1.695030019 podStartE2EDuration="2.172604848s" totalImagesPullingTime="477.574829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:21:31.169979697 +0000 UTC m=+1229.918029680" watchObservedRunningTime="2026-06-08 13:21:31.172604848 +0000 UTC m=+1229.920654830" Jun 08 13:21:42.160770 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:21:42.160739 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8756c68c-vsmn6" Jun 08 13:26:02.210566 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:26:02.210534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:26:02.216007 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:26:02.215987 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:26:02.217506 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:26:02.217485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:26:02.222564 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:26:02.222545 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:30:00.159842 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.159801 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29682090-gnwjh"] Jun 08 13:30:00.164301 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.164282 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:00.167359 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.167340 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9gsbd\"" Jun 08 13:30:00.183936 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.183909 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682090-gnwjh"] Jun 08 13:30:00.239516 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.239470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbg5z\" (UniqueName: \"kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z\") pod \"maas-api-key-cleanup-29682090-gnwjh\" (UID: \"871b3677-8ef9-4eda-98c4-b1c52238ee4c\") " pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:00.340513 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.340473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbg5z\" (UniqueName: \"kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z\") pod \"maas-api-key-cleanup-29682090-gnwjh\" (UID: \"871b3677-8ef9-4eda-98c4-b1c52238ee4c\") " pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:00.348866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.348836 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbg5z\" (UniqueName: \"kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z\") pod \"maas-api-key-cleanup-29682090-gnwjh\" (UID: \"871b3677-8ef9-4eda-98c4-b1c52238ee4c\") " pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:00.474901 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.474816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:00.606084 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.606059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682090-gnwjh"] Jun 08 13:30:00.608376 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:30:00.608341 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871b3677_8ef9_4eda_98c4_b1c52238ee4c.slice/crio-1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a WatchSource:0}: Error finding container 1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a: Status 404 returned error can't find the container with id 1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a Jun 08 13:30:00.610300 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.610284 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:30:00.732254 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:00.732175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" event={"ID":"871b3677-8ef9-4eda-98c4-b1c52238ee4c","Type":"ContainerStarted","Data":"1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a"} Jun 08 13:30:04.760013 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:04.759970 2573 generic.go:356] "Generic (PLEG): container finished" podID="871b3677-8ef9-4eda-98c4-b1c52238ee4c" containerID="1e4db5c60e564ad352558943f1cc0e990da2a9c9a69702f249cdbd341c70f0a5" exitCode=0 Jun 08 13:30:04.760439 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:04.760069 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" event={"ID":"871b3677-8ef9-4eda-98c4-b1c52238ee4c","Type":"ContainerDied","Data":"1e4db5c60e564ad352558943f1cc0e990da2a9c9a69702f249cdbd341c70f0a5"} Jun 08 13:30:05.900942 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:05.900920 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:05.993415 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:05.993381 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbg5z\" (UniqueName: \"kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z\") pod \"871b3677-8ef9-4eda-98c4-b1c52238ee4c\" (UID: \"871b3677-8ef9-4eda-98c4-b1c52238ee4c\") " Jun 08 13:30:05.995425 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:05.995397 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z" (OuterVolumeSpecName: "kube-api-access-tbg5z") pod "871b3677-8ef9-4eda-98c4-b1c52238ee4c" (UID: "871b3677-8ef9-4eda-98c4-b1c52238ee4c"). InnerVolumeSpecName "kube-api-access-tbg5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:30:06.094625 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:06.094538 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbg5z\" (UniqueName: \"kubernetes.io/projected/871b3677-8ef9-4eda-98c4-b1c52238ee4c-kube-api-access-tbg5z\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:30:06.770680 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:06.770651 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" Jun 08 13:30:06.770829 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:06.770650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682090-gnwjh" event={"ID":"871b3677-8ef9-4eda-98c4-b1c52238ee4c","Type":"ContainerDied","Data":"1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a"} Jun 08 13:30:06.770829 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:30:06.770770 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6b7cf19b25361428fc9734b7d71b75f73d607a2f3986be053b1fd38ed0fb8a" Jun 08 13:31:02.245489 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:31:02.245447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:31:02.253935 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:31:02.253911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:31:02.254149 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:31:02.253987 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:31:02.262195 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:31:02.262167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:32:00.634061 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:00.634013 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:32:00.636573 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:00.634236 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" containerName="manager" containerID="cri-o://16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e" gracePeriod=10 Jun 08 13:32:00.884574 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:00.884502 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:32:01.070934 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.070894 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqz9h\" (UniqueName: \"kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h\") pod \"37195358-01c6-473a-b8fa-b81f14c8d2c4\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " Jun 08 13:32:01.071142 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.070961 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume\") pod \"37195358-01c6-473a-b8fa-b81f14c8d2c4\" (UID: \"37195358-01c6-473a-b8fa-b81f14c8d2c4\") " Jun 08 13:32:01.071392 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.071366 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37195358-01c6-473a-b8fa-b81f14c8d2c4" (UID: "37195358-01c6-473a-b8fa-b81f14c8d2c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:32:01.073122 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.073027 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h" (OuterVolumeSpecName: "kube-api-access-kqz9h") pod "37195358-01c6-473a-b8fa-b81f14c8d2c4" (UID: "37195358-01c6-473a-b8fa-b81f14c8d2c4"). InnerVolumeSpecName "kube-api-access-kqz9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:32:01.172321 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.172281 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqz9h\" (UniqueName: \"kubernetes.io/projected/37195358-01c6-473a-b8fa-b81f14c8d2c4-kube-api-access-kqz9h\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:32:01.172321 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.172317 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37195358-01c6-473a-b8fa-b81f14c8d2c4-extensions-socket-volume\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:32:01.353351 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.353318 2573 generic.go:356] "Generic (PLEG): container finished" podID="37195358-01c6-473a-b8fa-b81f14c8d2c4" containerID="16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e" exitCode=0 Jun 08 13:32:01.353515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.353360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" event={"ID":"37195358-01c6-473a-b8fa-b81f14c8d2c4","Type":"ContainerDied","Data":"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e"} Jun 08 13:32:01.353515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.353397 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" event={"ID":"37195358-01c6-473a-b8fa-b81f14c8d2c4","Type":"ContainerDied","Data":"0f33ea2d6aede1cf434baaf9476edf2eb01093241ddca7f5444a012b83a16708"} Jun 08 13:32:01.353515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.353417 2573 scope.go:117] "RemoveContainer" containerID="16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e" Jun 08 13:32:01.353515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.353362 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925" Jun 08 13:32:01.363091 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.363068 2573 scope.go:117] "RemoveContainer" containerID="16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e" Jun 08 13:32:01.363381 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:32:01.363359 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e\": container with ID starting with 16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e not found: ID does not exist" containerID="16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e" Jun 08 13:32:01.363432 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.363390 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e"} err="failed to get container status \"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e\": rpc error: code = NotFound desc = could not find container \"16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e\": container with ID starting with 16bb33885a9a24fe62b763111bc62ba465c3a2b91ceefde6a8f476457826fb3e not found: ID does not exist" Jun 08 13:32:01.378316 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.378283 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:32:01.383059 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.383008 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cg925"] Jun 08 13:32:01.696629 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:32:01.696596 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" path="/var/lib/kubelet/pods/37195358-01c6-473a-b8fa-b81f14c8d2c4/volumes" Jun 08 13:33:06.807119 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807082 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd"] Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807481 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="871b3677-8ef9-4eda-98c4-b1c52238ee4c" containerName="cleanup" Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807492 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="871b3677-8ef9-4eda-98c4-b1c52238ee4c" containerName="cleanup" Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807510 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" containerName="manager" Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807516 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" containerName="manager" Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807578 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="871b3677-8ef9-4eda-98c4-b1c52238ee4c" containerName="cleanup" Jun 08 13:33:06.807593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.807588 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="37195358-01c6-473a-b8fa-b81f14c8d2c4" containerName="manager" Jun 08 13:33:06.810593 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.810577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.813434 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.813413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-srkxc\"" Jun 08 13:33:06.822344 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.822321 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd"] Jun 08 13:33:06.828343 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.828296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.828343 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.828333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6h5\" (UniqueName: \"kubernetes.io/projected/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-kube-api-access-gl6h5\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.929168 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.929132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.929168 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.929167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6h5\" (UniqueName: \"kubernetes.io/projected/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-kube-api-access-gl6h5\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.929503 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.929485 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:06.939937 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:06.939908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6h5\" (UniqueName: \"kubernetes.io/projected/1bbab31a-f9aa-4469-be70-2b9e7d18ea6c-kube-api-access-gl6h5\") pod \"kuadrant-operator-controller-manager-86878c769f-zn6sd\" (UID: \"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:07.121119 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.121006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:07.292772 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.292741 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd"] Jun 08 13:33:07.293331 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:33:07.293307 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbab31a_f9aa_4469_be70_2b9e7d18ea6c.slice/crio-c7f9b18262feceb0232aa85e6844642261c94e321a67f74ec76da0c6b3e064ab WatchSource:0}: Error finding container c7f9b18262feceb0232aa85e6844642261c94e321a67f74ec76da0c6b3e064ab: Status 404 returned error can't find the container with id c7f9b18262feceb0232aa85e6844642261c94e321a67f74ec76da0c6b3e064ab Jun 08 13:33:07.687943 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.687911 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" event={"ID":"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c","Type":"ContainerStarted","Data":"bd712e701742834bd209e5becb3845f4dc1f61c8d2d46aaa71029c335b23f140"} Jun 08 13:33:07.688138 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.687983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" event={"ID":"1bbab31a-f9aa-4469-be70-2b9e7d18ea6c","Type":"ContainerStarted","Data":"c7f9b18262feceb0232aa85e6844642261c94e321a67f74ec76da0c6b3e064ab"} Jun 08 13:33:07.688138 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.688121 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:33:07.713073 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:07.713013 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" podStartSLOduration=1.7129978000000001 podStartE2EDuration="1.7129978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:33:07.710965576 +0000 UTC m=+1926.459015559" watchObservedRunningTime="2026-06-08 13:33:07.7129978 +0000 UTC m=+1926.461047781" Jun 08 13:33:18.697368 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:33:18.697335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zn6sd" Jun 08 13:36:02.277635 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:36:02.277599 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:36:02.284563 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:36:02.284543 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:36:02.287815 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:36:02.287797 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:36:02.293803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:36:02.293786 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:41:02.310180 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:41:02.310148 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:41:02.317226 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:41:02.317198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:41:02.318941 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:41:02.318922 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:41:02.325294 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:41:02.325275 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l478c_cec7fa88-0ece-40f9-b479-feacdff10870/ovn-acl-logging/0.log" Jun 08 13:42:40.276303 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.276265 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:40.279935 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.279919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.283185 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.283155 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6025f4a4-openshift-default-dockercfg-mc8dq\"" Jun 08 13:42:40.304630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.304605 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:40.356135 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356161 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnrv2\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356306 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.356483 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.356365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457488 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457488 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457705 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457705 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457663 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnrv2\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457705 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457866 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457985 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457879 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457985 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457985 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457918 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.457985 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.457966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.458324 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.458280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.458454 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.458335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.458590 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.458571 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.460192 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.460171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.460441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.460414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.466386 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.466360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.466515 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.466499 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnrv2\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2\") pod \"e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.590740 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.590646 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:40.742831 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.742805 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:40.745399 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:42:40.745360 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54b79dc_6c4b_440d_af89_f999ef1540a0.slice/crio-8dc6d62c2d8185effad63baeab4f4ac6a0331ab5ad6cf1152381c98e32d6d3e7 WatchSource:0}: Error finding container 8dc6d62c2d8185effad63baeab4f4ac6a0331ab5ad6cf1152381c98e32d6d3e7: Status 404 returned error can't find the container with id 8dc6d62c2d8185effad63baeab4f4ac6a0331ab5ad6cf1152381c98e32d6d3e7 Jun 08 13:42:40.748133 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.748102 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:40.748248 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.748169 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:40.748248 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:40.748196 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:41.587129 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:41.587092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" event={"ID":"b54b79dc-6c4b-440d-af89-f999ef1540a0","Type":"ContainerStarted","Data":"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051"} Jun 08 13:42:41.587516 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:41.587170 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" event={"ID":"b54b79dc-6c4b-440d-af89-f999ef1540a0","Type":"ContainerStarted","Data":"8dc6d62c2d8185effad63baeab4f4ac6a0331ab5ad6cf1152381c98e32d6d3e7"} Jun 08 13:42:41.591337 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:41.591305 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:41.598026 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:41.598001 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:41.610719 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:41.610672 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" podStartSLOduration=1.6106585660000001 podStartE2EDuration="1.610658566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:42:41.608493045 +0000 UTC m=+2500.356543039" watchObservedRunningTime="2026-06-08 13:42:41.610658566 +0000 UTC m=+2500.358708546" Jun 08 13:42:42.593391 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:42.593360 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:42.594361 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:42.594341 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:46.631359 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:46.631319 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:46.631971 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:46.631517 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" podUID="b54b79dc-6c4b-440d-af89-f999ef1540a0" containerName="istio-proxy" containerID="cri-o://5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051" gracePeriod=30 Jun 08 13:42:51.882437 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.882411 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:51.969670 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969638 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.969849 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969691 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.969849 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969711 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.969849 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969734 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnrv2\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.969998 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969939 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.969998 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.969973 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:42:51.970144 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970091 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.970201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970142 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.970201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970170 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:42:51.970201 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970178 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.970352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970198 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:42:51.970352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970226 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data\") pod \"b54b79dc-6c4b-440d-af89-f999ef1540a0\" (UID: \"b54b79dc-6c4b-440d-af89-f999ef1540a0\") " Jun 08 13:42:51.970352 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970318 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:42:51.970569 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970528 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:42:51.970630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970567 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-credential-socket\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:51.970630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970587 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b54b79dc-6c4b-440d-af89-f999ef1540a0-istiod-ca-cert\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:51.970630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970600 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-certs\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:51.970630 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.970612 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-workload-socket\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:51.972220 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.972199 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 13:42:51.972332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.972246 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:42:51.972332 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.972263 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2" (OuterVolumeSpecName: "kube-api-access-dnrv2") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "kube-api-access-dnrv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:42:51.972405 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:51.972331 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b54b79dc-6c4b-440d-af89-f999ef1540a0" (UID: "b54b79dc-6c4b-440d-af89-f999ef1540a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:42:52.071389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.071351 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-envoy\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:52.071389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.071382 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-podinfo\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:52.071389 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.071392 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-data\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:52.071632 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.071405 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-istio-token\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:52.071632 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.071418 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnrv2\" (UniqueName: \"kubernetes.io/projected/b54b79dc-6c4b-440d-af89-f999ef1540a0-kube-api-access-dnrv2\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:42:52.645778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.645742 2573 generic.go:356] "Generic (PLEG): container finished" podID="b54b79dc-6c4b-440d-af89-f999ef1540a0" containerID="5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051" exitCode=0 Jun 08 13:42:52.645946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.645809 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" Jun 08 13:42:52.645946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.645826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" event={"ID":"b54b79dc-6c4b-440d-af89-f999ef1540a0","Type":"ContainerDied","Data":"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051"} Jun 08 13:42:52.645946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.645904 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj" event={"ID":"b54b79dc-6c4b-440d-af89-f999ef1540a0","Type":"ContainerDied","Data":"8dc6d62c2d8185effad63baeab4f4ac6a0331ab5ad6cf1152381c98e32d6d3e7"} Jun 08 13:42:52.645946 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.645926 2573 scope.go:117] "RemoveContainer" containerID="5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051" Jun 08 13:42:52.655778 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.655761 2573 scope.go:117] "RemoveContainer" containerID="5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051" Jun 08 13:42:52.656090 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:42:52.656068 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051\": container with ID starting with 5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051 not found: ID does not exist" containerID="5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051" Jun 08 13:42:52.656191 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.656097 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051"} err="failed to get container status \"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051\": rpc error: code = NotFound desc = could not find container \"5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051\": container with ID starting with 5fbd943a0e77b864d1ea480236512bee58c597e267d4295776d32bc23b82a051 not found: ID does not exist" Jun 08 13:42:52.669061 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.669023 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:52.677963 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.677941 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6025f4a4-openshift-default-77b4d49c8b-8vfjj"] Jun 08 13:42:52.899288 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.899206 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:42:52.899781 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.899762 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54b79dc-6c4b-440d-af89-f999ef1540a0" containerName="istio-proxy" Jun 08 13:42:52.899863 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.899784 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54b79dc-6c4b-440d-af89-f999ef1540a0" containerName="istio-proxy" Jun 08 13:42:52.899923 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.899909 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54b79dc-6c4b-440d-af89-f999ef1540a0" containerName="istio-proxy" Jun 08 13:42:52.904419 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.904398 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.909516 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.909496 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8476f5e8-openshift-default-dockercfg-l6kw9\"" Jun 08 13:42:52.971619 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.971586 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:42:52.978232 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978232 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7h8s\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:52.978692 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:52.978466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079336 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079336 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079594 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079594 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079594 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079594 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7h8s\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079803 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.079983 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.079859 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.080066 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.080010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.080202 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.080175 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.080293 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.080275 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.081757 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.081741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.082230 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.082214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.090083 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.090058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7h8s\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.090284 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.090265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token\") pod \"e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.215841 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.215730 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:53.380974 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.380942 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:42:53.383385 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:42:53.383356 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef8e3ed_632c_4eb3_962b_d409a174301e.slice/crio-6e239e6af9d41e1aa66a6075a98cf5123f83c9dd6454e36dcc4e797c2e218b1c WatchSource:0}: Error finding container 6e239e6af9d41e1aa66a6075a98cf5123f83c9dd6454e36dcc4e797c2e218b1c: Status 404 returned error can't find the container with id 6e239e6af9d41e1aa66a6075a98cf5123f83c9dd6454e36dcc4e797c2e218b1c Jun 08 13:42:53.385717 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.385689 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:53.385801 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.385748 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:53.385801 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.385776 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:42:53.654230 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.654197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" event={"ID":"6ef8e3ed-632c-4eb3-962b-d409a174301e","Type":"ContainerStarted","Data":"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be"} Jun 08 13:42:53.654405 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.654248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" event={"ID":"6ef8e3ed-632c-4eb3-962b-d409a174301e","Type":"ContainerStarted","Data":"6e239e6af9d41e1aa66a6075a98cf5123f83c9dd6454e36dcc4e797c2e218b1c"} Jun 08 13:42:53.675136 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.675029 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" podStartSLOduration=1.675011719 podStartE2EDuration="1.675011719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:42:53.674274397 +0000 UTC m=+2512.422324374" watchObservedRunningTime="2026-06-08 13:42:53.675011719 +0000 UTC m=+2512.423061700" Jun 08 13:42:53.695916 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:53.695883 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54b79dc-6c4b-440d-af89-f999ef1540a0" path="/var/lib/kubelet/pods/b54b79dc-6c4b-440d-af89-f999ef1540a0/volumes" Jun 08 13:42:54.216462 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:54.216423 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:54.221407 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:54.221382 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:54.660321 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:54.660295 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:42:54.661270 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:42:54.661253 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:43:00.374741 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:00.374704 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:43:00.375218 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:00.374883 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" podUID="6ef8e3ed-632c-4eb3-962b-d409a174301e" containerName="istio-proxy" containerID="cri-o://1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be" gracePeriod=30 Jun 08 13:43:05.634717 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.634656 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:43:05.718415 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.718381 2573 generic.go:356] "Generic (PLEG): container finished" podID="6ef8e3ed-632c-4eb3-962b-d409a174301e" containerID="1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be" exitCode=0 Jun 08 13:43:05.718572 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.718425 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" Jun 08 13:43:05.718572 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.718464 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" event={"ID":"6ef8e3ed-632c-4eb3-962b-d409a174301e","Type":"ContainerDied","Data":"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be"} Jun 08 13:43:05.718572 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.718515 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h" event={"ID":"6ef8e3ed-632c-4eb3-962b-d409a174301e","Type":"ContainerDied","Data":"6e239e6af9d41e1aa66a6075a98cf5123f83c9dd6454e36dcc4e797c2e218b1c"} Jun 08 13:43:05.718572 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.718537 2573 scope.go:117] "RemoveContainer" containerID="1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be" Jun 08 13:43:05.727215 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.727197 2573 scope.go:117] "RemoveContainer" containerID="1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be" Jun 08 13:43:05.727480 ip-10-0-140-115 kubenswrapper[2573]: E0608 13:43:05.727463 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be\": container with ID starting with 1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be not found: ID does not exist" containerID="1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be" Jun 08 13:43:05.727546 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.727493 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be"} err="failed to get container status \"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be\": rpc error: code = NotFound desc = could not find container \"1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be\": container with ID starting with 1c9bd5aaf345c06c6d26d8a263443e9d739396378a28a1522d863e3e5a5a38be not found: ID does not exist" Jun 08 13:43:05.799889 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.799856 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800089 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.799902 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7h8s\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800089 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.799921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800089 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800076 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800263 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800124 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800263 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800153 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800345 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800256 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800345 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800273 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:43:05.800345 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800292 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800498 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800353 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy\") pod \"6ef8e3ed-632c-4eb3-962b-d409a174301e\" (UID: \"6ef8e3ed-632c-4eb3-962b-d409a174301e\") " Jun 08 13:43:05.800553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800478 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:43:05.800633 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800583 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:43:05.800633 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800621 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:43:05.800752 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800682 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:43:05.800805 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800761 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-certs\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.800805 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800777 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ef8e3ed-632c-4eb3-962b-d409a174301e-istiod-ca-cert\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.800805 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800786 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-workload-socket\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.800805 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800793 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-data\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.801014 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.800805 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-credential-socket\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.802441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.802414 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 13:43:05.802552 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.802529 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:43:05.802618 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.802590 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s" (OuterVolumeSpecName: "kube-api-access-z7h8s") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "kube-api-access-z7h8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:43:05.802618 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.802604 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ef8e3ed-632c-4eb3-962b-d409a174301e" (UID: "6ef8e3ed-632c-4eb3-962b-d409a174301e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:43:05.901460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.901432 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-podinfo\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.901460 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.901458 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7h8s\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-kube-api-access-z7h8s\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.901659 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.901468 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-token\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:05.901659 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:05.901477 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ef8e3ed-632c-4eb3-962b-d409a174301e-istio-envoy\") on node \"ip-10-0-140-115.ec2.internal\" DevicePath \"\"" Jun 08 13:43:06.042855 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:06.042819 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:43:06.047459 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:06.047432 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8476f5e8-openshift-default-76cfb6dd8-wzv7h"] Jun 08 13:43:07.695451 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:07.695415 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef8e3ed-632c-4eb3-962b-d409a174301e" path="/var/lib/kubelet/pods/6ef8e3ed-632c-4eb3-962b-d409a174301e/volumes" Jun 08 13:43:12.898289 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:12.898259 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c8b79977-f7f8d_5ce5f505-4462-4e49-b657-69dda0e7c189/authorino/0.log" Jun 08 13:43:17.585232 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:17.585207 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc4849f48-x26gx_b062b656-ff51-4758-bc74-81b62e01b0a0/nginx/0.log" Jun 08 13:43:18.037572 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:18.037542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682090-gnwjh_871b3677-8ef9-4eda-98c4-b1c52238ee4c/cleanup/0.log" Jun 08 13:43:18.170422 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:18.170386 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c8756c68c-vsmn6_e832df17-4b68-4c05-9487-21254e486bb5/manager/0.log" Jun 08 13:43:18.661109 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:18.661078 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-648w6_6576c09d-44d8-441a-be75-67ae041d7184/manager/0.log" Jun 08 13:43:18.668322 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:18.668300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-648w6_6576c09d-44d8-441a-be75-67ae041d7184/copy-manifests/0.log" Jun 08 13:43:20.229502 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:20.229469 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c8b79977-f7f8d_5ce5f505-4462-4e49-b657-69dda0e7c189/authorino/0.log" Jun 08 13:43:20.490718 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:20.490635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwvkm_2560e285-8665-40ed-877c-72ed9bcc774b/manager/0.log" Jun 08 13:43:20.743868 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:20.743785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c4srh_e4497de2-4b59-4dda-9414-d9326057b68b/registry-server/0.log" Jun 08 13:43:20.869477 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:20.869444 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zn6sd_1bbab31a-f9aa-4469-be70-2b9e7d18ea6c/manager/0.log" Jun 08 13:43:21.113856 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:21.113784 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tfmkr_1407d881-4f65-4b9d-9f7f-14859ee494b1/manager/0.log" Jun 08 13:43:21.465445 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:21.465421 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjvssn_0a9a545c-0822-4828-8575-54ff566d1f6c/istio-proxy/0.log" Jun 08 13:43:21.927179 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:21.927147 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/1.log" Jun 08 13:43:30.356078 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:30.356027 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hhppx_e3cee424-9928-41d2-96b6-67023771461a/global-pull-secret-syncer/0.log" Jun 08 13:43:30.437757 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:30.437726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d6q9d_a622002f-abba-4298-b114-cb59089c429b/konnectivity-agent/0.log" Jun 08 13:43:30.541295 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:30.541260 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-115.ec2.internal_e5eb004ba21b3349901d891de0befaa4/haproxy/0.log" Jun 08 13:43:35.193462 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:35.193427 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c8b79977-f7f8d_5ce5f505-4462-4e49-b657-69dda0e7c189/authorino/0.log" Jun 08 13:43:35.260138 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:35.260107 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwvkm_2560e285-8665-40ed-877c-72ed9bcc774b/manager/0.log" Jun 08 13:43:35.336488 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:35.336462 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c4srh_e4497de2-4b59-4dda-9414-d9326057b68b/registry-server/0.log" Jun 08 13:43:35.408801 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:35.408763 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zn6sd_1bbab31a-f9aa-4469-be70-2b9e7d18ea6c/manager/0.log" Jun 08 13:43:35.503203 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:35.503176 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tfmkr_1407d881-4f65-4b9d-9f7f-14859ee494b1/manager/0.log" Jun 08 13:43:37.294923 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.294893 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-vkj85_d49a28a2-3e53-4f65-979d-9cbf25e7bb8b/cluster-monitoring-operator/0.log" Jun 08 13:43:37.353080 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.353055 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rpv4m_6d559b15-4af6-4eed-b894-79a58582bc99/kube-state-metrics/0.log" Jun 08 13:43:37.395245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.395221 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rpv4m_6d559b15-4af6-4eed-b894-79a58582bc99/kube-rbac-proxy-main/0.log" Jun 08 13:43:37.423870 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.423846 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-rpv4m_6d559b15-4af6-4eed-b894-79a58582bc99/kube-rbac-proxy-self/0.log" Jun 08 13:43:37.482497 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.482468 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-sglxx_0de95c69-0a09-4736-a85e-85c87218e3f0/monitoring-plugin/0.log" Jun 08 13:43:37.523570 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.523538 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47q54_bfb31783-685b-4ef6-9027-19d34016cc08/node-exporter/0.log" Jun 08 13:43:37.548272 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.548239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47q54_bfb31783-685b-4ef6-9027-19d34016cc08/kube-rbac-proxy/0.log" Jun 08 13:43:37.577297 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.577272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47q54_bfb31783-685b-4ef6-9027-19d34016cc08/init-textfile/0.log" Jun 08 13:43:37.868933 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.868837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ccm8d_d2c5fb8a-d59f-4a91-a34c-393fc82da5ec/kube-rbac-proxy-main/0.log" Jun 08 13:43:37.902424 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.902389 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ccm8d_d2c5fb8a-d59f-4a91-a34c-393fc82da5ec/kube-rbac-proxy-self/0.log" Jun 08 13:43:37.938802 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:37.938772 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ccm8d_d2c5fb8a-d59f-4a91-a34c-393fc82da5ec/openshift-state-metrics/0.log" Jun 08 13:43:38.022202 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.022177 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/prometheus/0.log" Jun 08 13:43:38.082226 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.082200 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/config-reloader/0.log" Jun 08 13:43:38.138081 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.138032 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/thanos-sidecar/0.log" Jun 08 13:43:38.183184 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.183154 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/kube-rbac-proxy-web/0.log" Jun 08 13:43:38.230576 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.230552 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/kube-rbac-proxy/0.log" Jun 08 13:43:38.271988 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.271961 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/kube-rbac-proxy-thanos/0.log" Jun 08 13:43:38.328314 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:38.328287 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8348a2da-a2d0-472b-ab27-27aabad2f0f9/init-config-reloader/0.log" Jun 08 13:43:40.217553 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:40.217522 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-m24c2_a9f1f54d-4145-49e1-9f61-3f54b249e108/networking-console-plugin/0.log" Jun 08 13:43:40.912287 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:40.912252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/2.log" Jun 08 13:43:40.916346 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:40.916319 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jkftg_a4e5afe6-69a8-47a2-ac61-ed7ab109c913/console-operator/3.log" Jun 08 13:43:41.945210 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.945180 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl"] Jun 08 13:43:41.945580 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.945558 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef8e3ed-632c-4eb3-962b-d409a174301e" containerName="istio-proxy" Jun 08 13:43:41.945580 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.945569 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef8e3ed-632c-4eb3-962b-d409a174301e" containerName="istio-proxy" Jun 08 13:43:41.945652 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.945645 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef8e3ed-632c-4eb3-962b-d409a174301e" containerName="istio-proxy" Jun 08 13:43:41.948688 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.948672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:41.953388 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.953365 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flk4d\"/\"default-dockercfg-mqgqd\"" Jun 08 13:43:41.953533 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.953366 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"kube-root-ca.crt\"" Jun 08 13:43:41.954575 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.954554 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"openshift-service-ca.crt\"" Jun 08 13:43:41.959624 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:41.959603 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl"] Jun 08 13:43:42.036885 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.036846 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-lib-modules\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.037093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.036913 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-proc\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.037093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.036963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6wv\" (UniqueName: \"kubernetes.io/projected/c688eb6d-c00a-46a8-b655-72660bded35d-kube-api-access-hk6wv\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.037093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.037011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-sys\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.037093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.037086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-podres\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138034 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.137996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-lib-modules\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-proc\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6wv\" (UniqueName: \"kubernetes.io/projected/c688eb6d-c00a-46a8-b655-72660bded35d-kube-api-access-hk6wv\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138185 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-lib-modules\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-sys\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138230 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-proc\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-podres\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138476 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-sys\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.138476 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.138359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c688eb6d-c00a-46a8-b655-72660bded35d-podres\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.147378 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.147349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6wv\" (UniqueName: \"kubernetes.io/projected/c688eb6d-c00a-46a8-b655-72660bded35d-kube-api-access-hk6wv\") pod \"perf-node-gather-daemonset-msqnl\" (UID: \"c688eb6d-c00a-46a8-b655-72660bded35d\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.259147 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.259053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.288845 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.288817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-lqs86_0a3378f7-99df-4841-b3ce-148fe5b162f8/volume-data-source-validator/0.log" Jun 08 13:43:42.404964 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.404819 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl"] Jun 08 13:43:42.408001 ip-10-0-140-115 kubenswrapper[2573]: W0608 13:43:42.407968 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc688eb6d_c00a_46a8_b655_72660bded35d.slice/crio-ad6ffcabbf7b41b8322baa4e47af04fc6197d65ab8b864cfaef6e9669153a31b WatchSource:0}: Error finding container ad6ffcabbf7b41b8322baa4e47af04fc6197d65ab8b864cfaef6e9669153a31b: Status 404 returned error can't find the container with id ad6ffcabbf7b41b8322baa4e47af04fc6197d65ab8b864cfaef6e9669153a31b Jun 08 13:43:42.912292 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.912257 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" event={"ID":"c688eb6d-c00a-46a8-b655-72660bded35d","Type":"ContainerStarted","Data":"609832504bb847cc7c3b4537883ebeb9bcbc663e14de1bcacb1d63f665ed595e"} Jun 08 13:43:42.912509 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.912308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" event={"ID":"c688eb6d-c00a-46a8-b655-72660bded35d","Type":"ContainerStarted","Data":"ad6ffcabbf7b41b8322baa4e47af04fc6197d65ab8b864cfaef6e9669153a31b"} Jun 08 13:43:42.912509 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.912345 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:42.929910 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:42.929858 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" podStartSLOduration=1.929841847 podStartE2EDuration="1.929841847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:42.928838443 +0000 UTC m=+2561.676888426" watchObservedRunningTime="2026-06-08 13:43:42.929841847 +0000 UTC m=+2561.677891828" Jun 08 13:43:43.438261 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:43.438225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rfqd_d5dc6374-af77-41d4-80b1-2223bdc90381/dns/0.log" Jun 08 13:43:43.462731 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:43.462705 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rfqd_d5dc6374-af77-41d4-80b1-2223bdc90381/kube-rbac-proxy/0.log" Jun 08 13:43:43.602093 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:43.602069 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nwrs_9e1a4991-f8b9-426c-8d3a-e628e0f84084/dns-node-resolver/0.log" Jun 08 13:43:44.294599 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:44.294565 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxv7x_ca3339d3-e2a1-4cce-ba40-38936b775d80/node-ca/0.log" Jun 08 13:43:45.322421 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:45.322395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjvssn_0a9a545c-0822-4828-8575-54ff566d1f6c/istio-proxy/0.log" Jun 08 13:43:45.483177 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:45.483146 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/0.log" Jun 08 13:43:45.513060 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:45.513012 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/1.log" Jun 08 13:43:46.293232 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:46.293201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkb5x_1e66a5a2-1298-4f8a-9fa0-9fd32dcdb321/serve-healthcheck-canary/0.log" Jun 08 13:43:46.884371 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:46.884337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4xcqm_0ec7a948-9cbb-49b6-b141-fd4fec23853c/insights-operator/0.log" Jun 08 13:43:46.885264 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:46.885244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4xcqm_0ec7a948-9cbb-49b6-b141-fd4fec23853c/insights-operator/1.log" Jun 08 13:43:46.990845 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:46.990820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nmbd_410a4f3e-89a0-46f7-8f75-2c383058e92d/kube-rbac-proxy/0.log" Jun 08 13:43:47.014558 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:47.014530 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nmbd_410a4f3e-89a0-46f7-8f75-2c383058e92d/exporter/0.log" Jun 08 13:43:47.043149 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:47.043124 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nmbd_410a4f3e-89a0-46f7-8f75-2c383058e92d/extractor/0.log" Jun 08 13:43:48.927834 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:48.927803 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-msqnl" Jun 08 13:43:49.455567 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:49.455542 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc4849f48-x26gx_b062b656-ff51-4758-bc74-81b62e01b0a0/nginx/0.log" Jun 08 13:43:49.653548 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:49.653520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682090-gnwjh_871b3677-8ef9-4eda-98c4-b1c52238ee4c/cleanup/0.log" Jun 08 13:43:49.747441 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:49.747361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c8756c68c-vsmn6_e832df17-4b68-4c05-9487-21254e486bb5/manager/0.log" Jun 08 13:43:50.003465 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:50.003378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-648w6_6576c09d-44d8-441a-be75-67ae041d7184/manager/0.log" Jun 08 13:43:50.027473 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:50.027451 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-648w6_6576c09d-44d8-441a-be75-67ae041d7184/copy-manifests/0.log" Jun 08 13:43:51.881659 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:51.881626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf59b74dc-9gn5k_7e295113-7a3f-43a2-bb72-d5a4a32704b1/manager/0.log" Jun 08 13:43:55.031883 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:55.031839 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjvssn_0a9a545c-0822-4828-8575-54ff566d1f6c/istio-proxy/0.log" Jun 08 13:43:55.154542 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:55.154507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/0.log" Jun 08 13:43:55.189205 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:55.189172 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/1.log" Jun 08 13:43:56.418564 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:56.418533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjvssn_0a9a545c-0822-4828-8575-54ff566d1f6c/istio-proxy/0.log" Jun 08 13:43:56.539661 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:56.539632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/0.log" Jun 08 13:43:56.570160 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:56.570132 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/1.log" Jun 08 13:43:57.483464 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:57.483436 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vtn59_0bf29a93-f38d-4f9b-9a70-f19cc2db54aa/migrator/0.log" Jun 08 13:43:57.509203 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:57.509174 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vtn59_0bf29a93-f38d-4f9b-9a70-f19cc2db54aa/graceful-termination/0.log" Jun 08 13:43:57.980245 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:57.980205 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9spjd_af38b37e-d7bd-4491-a242-71cf9d30f483/kube-storage-version-migrator-operator/1.log" Jun 08 13:43:57.981052 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:57.981023 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-9spjd_af38b37e-d7bd-4491-a242-71cf9d30f483/kube-storage-version-migrator-operator/0.log" Jun 08 13:43:58.397243 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:58.397216 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjvssn_0a9a545c-0822-4828-8575-54ff566d1f6c/istio-proxy/0.log" Jun 08 13:43:58.512909 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:58.512877 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/0.log" Jun 08 13:43:58.544053 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:58.544011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-gcv47_7249bbb1-915d-4981-8f42-2bd17c8d55d3/istio-proxy/1.log" Jun 08 13:43:59.257504 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:59.257477 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-24ddp_1cf764e3-72be-4a6b-ad64-af7ce6c84136/kube-multus/0.log" Jun 08 13:43:59.714663 ip-10-0-140-115 kubenswrapper[2573]: I0608 13:43:59.714629 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x8n7j_0a062ef4-320b-4085-a1ca-405738285104/kube-multus-additional-cni-plugins/0.log"