Jun 02 16:38:57.132355 ip-10-0-131-40 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 16:38:57.132367 ip-10-0-131-40 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 16:38:57.132376 ip-10-0-131-40 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 16:38:57.132697 ip-10-0-131-40 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 16:39:07.022931 ip-10-0-131-40 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 16:39:07.022944 ip-10-0-131-40 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 18fa3f2e76894457b466e53a3e868002 -- Jun 02 16:41:19.758047 ip-10-0-131-40 systemd[1]: Starting Kubernetes Kubelet... Jun 02 16:41:20.237990 ip-10-0-131-40 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:20.237990 ip-10-0-131-40 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 16:41:20.237990 ip-10-0-131-40 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:20.237990 ip-10-0-131-40 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 16:41:20.237990 ip-10-0-131-40 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:20.240995 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.240891 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 16:41:20.247613 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247595 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:20.247613 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247614 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247618 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247621 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247624 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247628 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247631 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247634 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247636 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247639 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247642 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247645 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247647 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247652 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247657 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247660 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247663 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247667 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247671 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247674 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:20.247726 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247677 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247680 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247682 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247685 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247688 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247690 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247700 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247703 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247706 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247708 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247711 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247714 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247716 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247719 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247722 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247725 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247728 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247731 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247733 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247736 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:20.248204 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247739 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247742 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247761 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247765 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247767 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247770 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247773 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247775 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247778 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247780 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247783 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247786 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247789 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247792 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247794 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247796 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247799 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247801 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247804 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247807 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:20.248689 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247810 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247812 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247815 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247818 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247820 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247823 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247825 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247828 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247831 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247834 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247837 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247840 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247842 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247845 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247847 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247851 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247853 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247856 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247858 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247861 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:20.249200 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247863 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247866 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247870 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247872 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247875 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.247878 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248281 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248286 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248289 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248292 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248294 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248297 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248300 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248303 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248305 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248308 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248311 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248314 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248316 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248320 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:20.249666 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248323 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248325 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248328 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248331 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248333 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248336 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248339 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248341 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248344 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248347 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248349 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248351 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248354 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248357 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248360 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248362 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248366 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248370 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248373 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248376 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:20.250142 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248379 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248382 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248385 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248388 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248393 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248396 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248398 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248401 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248404 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248407 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248410 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248413 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248416 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248419 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248422 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248424 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248427 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248429 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248432 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:20.250640 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248435 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248437 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248440 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248442 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248445 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248447 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248450 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248452 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248454 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248457 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248459 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248462 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248465 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248467 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248470 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248472 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248475 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248477 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248480 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248483 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:20.251121 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248486 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248488 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248490 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248506 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248510 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248512 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248516 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248520 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248522 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248525 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248527 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248530 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.248532 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249934 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249946 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249953 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249958 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249963 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249966 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249971 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249975 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 16:41:20.251631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249979 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249982 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249985 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249988 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249992 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249995 2565 flags.go:64] FLAG: --cgroup-root="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.249998 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250001 2565 flags.go:64] FLAG: --client-ca-file="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250004 2565 flags.go:64] FLAG: --cloud-config="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250007 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250010 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250014 2565 flags.go:64] FLAG: --cluster-domain="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250017 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250020 2565 flags.go:64] FLAG: --config-dir="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250023 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250027 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250032 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250035 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250038 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250041 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250044 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250047 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250050 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250054 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250056 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 16:41:20.252166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250061 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250064 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250067 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250070 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250073 2565 flags.go:64] FLAG: --enable-server="true" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250076 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250080 2565 flags.go:64] FLAG: --event-burst="100" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250083 2565 flags.go:64] FLAG: --event-qps="50" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250086 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250090 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250093 2565 flags.go:64] FLAG: --eviction-hard="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250096 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250099 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250102 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250105 2565 flags.go:64] FLAG: --eviction-soft="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250108 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250110 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250113 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250117 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250120 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250124 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250127 2565 flags.go:64] FLAG: --feature-gates="" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250131 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250134 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250137 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 16:41:20.252793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250140 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250143 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250146 2565 flags.go:64] FLAG: --help="false" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250149 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250153 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250156 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250159 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250162 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250165 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250168 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250171 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250174 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250177 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250180 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250183 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250185 2565 flags.go:64] FLAG: --kube-reserved="" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250188 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250191 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250194 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250196 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250199 2565 flags.go:64] FLAG: --lock-file="" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250202 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250205 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250208 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 16:41:20.253369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250214 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250217 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250221 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250224 2565 flags.go:64] FLAG: --logging-format="text" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250227 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250230 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250233 2565 flags.go:64] FLAG: --manifest-url="" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250236 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250240 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250243 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250247 2565 flags.go:64] FLAG: --max-pods="110" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250250 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250253 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250256 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250259 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250262 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250265 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250268 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250276 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250279 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250282 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250285 2565 flags.go:64] FLAG: --pod-cidr="" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250288 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 16:41:20.253941 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250293 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250296 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250299 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250302 2565 flags.go:64] FLAG: --port="10250" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250304 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250307 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c858b41943f9a31" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250311 2565 flags.go:64] FLAG: --qos-reserved="" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250314 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250317 2565 flags.go:64] FLAG: --register-node="true" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250320 2565 flags.go:64] FLAG: --register-schedulable="true" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250323 2565 flags.go:64] FLAG: --register-with-taints="" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250326 2565 flags.go:64] FLAG: --registry-burst="10" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250330 2565 flags.go:64] FLAG: --registry-qps="5" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250333 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250336 2565 flags.go:64] FLAG: --reserved-memory="" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250339 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250342 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250345 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250348 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250350 2565 flags.go:64] FLAG: --runonce="false" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250353 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250356 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250359 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250362 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250364 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250367 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 16:41:20.254472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250370 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250373 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250376 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250379 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250382 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250385 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250388 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250391 2565 flags.go:64] FLAG: --system-cgroups="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250394 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250399 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250402 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250405 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250409 2565 flags.go:64] FLAG: --tls-min-version="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250412 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250415 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250418 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250420 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250423 2565 flags.go:64] FLAG: --v="2" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250427 2565 flags.go:64] FLAG: --version="false" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250432 2565 flags.go:64] FLAG: --vmodule="" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250436 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.250439 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250539 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250544 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:20.255097 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250547 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250550 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250553 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250556 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250562 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250565 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250567 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250570 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250573 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250575 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250578 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250581 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250583 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250586 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250588 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250591 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250594 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250597 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250599 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250602 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:20.255711 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250605 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250607 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250610 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250612 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250615 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250617 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250620 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250622 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250628 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250630 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250633 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250635 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250638 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250640 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250643 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250647 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250650 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250653 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250655 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:20.256263 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250658 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250660 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250663 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250666 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250668 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250671 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250673 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250676 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250680 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250682 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250684 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250687 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250689 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250692 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250694 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250697 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250699 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250702 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250704 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250707 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:20.256768 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250710 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250712 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250715 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250717 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250720 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250722 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250725 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250729 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250734 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250737 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250740 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250742 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250763 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250765 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250768 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250771 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250773 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250776 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250778 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:20.257284 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250781 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:20.257832 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250784 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:20.257832 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250787 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:20.257832 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250789 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:20.257832 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.250792 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:20.257832 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.251605 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:20.259095 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.259068 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 16:41:20.259095 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.259092 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259146 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259151 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259155 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259158 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259161 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259164 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259167 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259169 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259172 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259176 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259180 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259183 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259186 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259188 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259191 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259194 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259196 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259199 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:20.259223 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259202 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259205 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259207 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259210 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259212 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259215 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259217 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259221 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259223 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259226 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259229 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259231 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259234 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259237 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259239 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259242 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259244 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259247 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259250 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259252 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:20.259722 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259254 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259257 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259259 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259262 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259264 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259267 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259271 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259274 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259277 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259280 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259283 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259285 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259288 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259291 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259293 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259296 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259298 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259301 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259303 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259305 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:20.260328 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259308 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259311 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259313 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259316 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259318 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259320 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259323 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259325 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259328 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259330 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259333 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259335 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259338 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259340 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259343 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259345 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259348 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259350 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259360 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259363 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:20.260830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259366 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259377 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259380 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259382 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259385 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259387 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259390 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259393 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.259398 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259515 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259519 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259522 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259525 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259527 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259530 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259533 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:20.261288 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259536 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259540 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259543 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259547 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259550 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259552 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259555 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259557 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259560 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259563 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259565 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259568 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259571 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259573 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259576 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259579 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259582 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259584 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259587 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:20.261676 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259590 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259593 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259595 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259598 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259600 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259603 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259605 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259608 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259610 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259612 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259615 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259617 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259620 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259622 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259625 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259628 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259630 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259633 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259635 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259638 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:20.262145 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259640 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259643 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259645 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259648 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259650 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259653 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259655 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259658 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259660 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259663 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259666 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259669 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259671 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259674 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259677 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259679 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259682 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259684 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259687 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259690 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:20.262600 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259692 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259695 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259698 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259700 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259703 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259706 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259709 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259712 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259715 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259718 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259720 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259723 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259725 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259728 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259731 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259733 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259736 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259739 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259741 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:20.263086 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:20.259763 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:20.263566 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.259770 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:20.263566 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.260455 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 16:41:20.265021 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.265007 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 16:41:20.265996 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.265983 2565 server.go:1019] "Starting client certificate rotation" Jun 02 16:41:20.266096 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.266083 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:20.266127 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.266119 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:20.295353 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.295322 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:20.299397 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.299356 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:20.321512 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.321482 2565 log.go:25] "Validated CRI v1 runtime API" Jun 02 16:41:20.326345 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.326317 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:20.326993 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.326980 2565 log.go:25] "Validated CRI v1 image API" Jun 02 16:41:20.328673 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.328659 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 16:41:20.333114 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.333092 2565 fs.go:135] Filesystem UUIDs: map[1e95dd1c-9d4d-44d0-bb00-8dc72a25ce7e:/dev/nvme0n1p4 233b72c9-792a-4473-919d-a18812095da6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 16:41:20.333162 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.333114 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 16:41:20.338163 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.338055 2565 manager.go:217] Machine: {Timestamp:2026-06-02 16:41:20.337526032 +0000 UTC m=+0.450079890 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3193489 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28fc3482e1f7f51492c0f32dfc9e5a SystemUUID:ec28fc34-82e1-f7f5-1492-c0f32dfc9e5a BootID:18fa3f2e-7689-4457-b466-e53a3e868002 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:b6:fc:01:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:b6:fc:01:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:f5:63:0d:63:03 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 16:41:20.338866 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.338855 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 16:41:20.338954 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.338942 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 16:41:20.341742 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.341704 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 16:41:20.341943 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.341742 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 16:41:20.341998 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.341953 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 16:41:20.341998 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.341963 2565 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 16:41:20.341998 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.341971 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:20.342788 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.342777 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:20.344213 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.344203 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:20.344336 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.344326 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 16:41:20.347349 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.347339 2565 kubelet.go:491] "Attempting to sync node with API server" Jun 02 16:41:20.347429 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.347352 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 16:41:20.347429 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.347376 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 16:41:20.347429 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.347387 2565 kubelet.go:397] "Adding apiserver pod source" Jun 02 16:41:20.347429 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.347397 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 16:41:20.348557 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.348537 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67s6z" Jun 02 16:41:20.348645 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.348635 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:20.348684 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.348652 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:20.357095 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.357073 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67s6z" Jun 02 16:41:20.363693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.363660 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 16:41:20.364683 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.364660 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 16:41:20.364683 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.364664 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 16:41:20.365900 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.365888 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 16:41:20.367943 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367931 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367948 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367955 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367961 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367969 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367974 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367980 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 16:41:20.367986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367985 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 16:41:20.368172 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.367993 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 16:41:20.368172 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.368001 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 16:41:20.368172 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.368010 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 16:41:20.368172 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.368015 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 16:41:20.368873 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.368863 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 16:41:20.368873 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.368873 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 16:41:20.372135 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.372121 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 16:41:20.372186 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.372161 2565 server.go:1295] "Started kubelet" Jun 02 16:41:20.372342 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.372209 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 16:41:20.372416 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.372366 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 16:41:20.372467 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.372442 2565 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 16:41:20.373152 ip-10-0-131-40 systemd[1]: Started Kubernetes Kubelet. Jun 02 16:41:20.373613 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.373500 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 16:41:20.375081 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.375067 2565 server.go:317] "Adding debug handlers to kubelet server" Jun 02 16:41:20.378242 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.378223 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:20.378677 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.378647 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 16:41:20.379041 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.379021 2565 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 16:41:20.379041 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.379038 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 16:41:20.379221 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.379210 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 16:41:20.379334 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.379316 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 02 16:41:20.379480 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.379469 2565 reconciler.go:26] "Reconciler: start to sync state" Jun 02 16:41:20.379954 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.379915 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.381837 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.381735 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:20.382369 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.382348 2565 factory.go:55] Registering systemd factory Jun 02 16:41:20.382437 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.382406 2565 factory.go:223] Registration of the systemd container factory successfully Jun 02 16:41:20.382712 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.382698 2565 factory.go:153] Registering CRI-O factory Jun 02 16:41:20.383562 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.383505 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-40.ec2.internal\" not found" node="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.383562 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.383546 2565 factory.go:223] Registration of the crio container factory successfully Jun 02 16:41:20.383692 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.383637 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 16:41:20.383692 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.383661 2565 factory.go:103] Registering Raw factory Jun 02 16:41:20.383692 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.383683 2565 manager.go:1196] Started watching for new ooms in manager Jun 02 16:41:20.384073 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.383461 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-40.ec2.internal" not found Jun 02 16:41:20.384600 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.384583 2565 manager.go:319] Starting recovery of all containers Jun 02 16:41:20.384694 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.384674 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 16:41:20.397025 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.396898 2565 manager.go:324] Recovery completed Jun 02 16:41:20.399243 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.399222 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-40.ec2.internal" not found Jun 02 16:41:20.401147 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.401134 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.403101 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403085 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.403168 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403114 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.403168 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403125 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.403632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403619 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 16:41:20.403632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403630 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 16:41:20.403708 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.403647 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:20.405567 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.405555 2565 policy_none.go:49] "None policy: Start" Jun 02 16:41:20.405603 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.405574 2565 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 16:41:20.405603 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.405584 2565 state_mem.go:35] "Initializing new in-memory state store" Jun 02 16:41:20.430360 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430341 2565 manager.go:341] "Starting Device Plugin manager" Jun 02 16:41:20.430482 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.430394 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 16:41:20.430482 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430405 2565 server.go:85] "Starting device plugin registration server" Jun 02 16:41:20.430684 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430672 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 16:41:20.430720 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430685 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 16:41:20.430804 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430789 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 16:41:20.430961 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430872 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 16:41:20.430961 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.430888 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 16:41:20.431700 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.431681 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 16:41:20.431792 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.431725 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.463682 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.463652 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-40.ec2.internal" not found Jun 02 16:41:20.490536 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.490463 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 16:41:20.491785 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.491767 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 16:41:20.491852 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.491800 2565 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 16:41:20.491852 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.491820 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 16:41:20.491852 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.491828 2565 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 16:41:20.491994 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.491867 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 16:41:20.494172 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.494153 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:20.531149 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.531119 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.532136 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.532118 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.532263 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.532146 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.532263 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.532157 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.532263 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.532185 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.541888 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.541865 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.541888 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.541888 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-40.ec2.internal\": node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.557561 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.557530 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.592673 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.592648 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal"] Jun 02 16:41:20.592837 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.592765 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.595528 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.595513 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.595606 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.595542 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.595606 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.595552 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.596815 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.596803 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.596899 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.596885 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.596932 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.596923 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.597575 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597562 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.597632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597565 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.597632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597610 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.597632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597621 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.597714 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597591 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.597714 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.597658 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.598705 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.598693 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.598741 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.598717 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:20.602392 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.602376 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:20.602471 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.602405 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:20.602471 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.602420 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:20.619432 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.619391 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-40.ec2.internal\" not found" node="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.624725 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.624705 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-40.ec2.internal\" not found" node="ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.658091 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.658062 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.680830 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.680804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.680891 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.680834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.680891 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.680851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/750685bd4b4365c66e32e39d3b8c8a62-config\") pod \"kube-apiserver-proxy-ip-10-0-131-40.ec2.internal\" (UID: \"750685bd4b4365c66e32e39d3b8c8a62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.758958 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.758895 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.781688 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781661 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/750685bd4b4365c66e32e39d3b8c8a62-config\") pod \"kube-apiserver-proxy-ip-10-0-131-40.ec2.internal\" (UID: \"750685bd4b4365c66e32e39d3b8c8a62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.781796 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781692 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.781796 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781714 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.781796 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.781911 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/621d7a745586b141902a7d8439613a76-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal\" (UID: \"621d7a745586b141902a7d8439613a76\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.781911 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.781773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/750685bd4b4365c66e32e39d3b8c8a62-config\") pod \"kube-apiserver-proxy-ip-10-0-131-40.ec2.internal\" (UID: \"750685bd4b4365c66e32e39d3b8c8a62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.859226 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.859192 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:20.921849 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.921813 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.928390 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:20.928370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:20.959499 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:20.959463 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.059975 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.059897 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.160412 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.160380 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.211001 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.210970 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:21.261002 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.260969 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.266116 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.266098 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 16:41:21.266239 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.266224 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:21.266287 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.266252 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:21.266287 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.266254 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:21.361897 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.361857 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.361897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.361872 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:36:20 +0000 UTC" deadline="2027-12-07 23:37:53.539128921 +0000 UTC" Jun 02 16:41:21.362095 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.361915 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13278h56m32.177219396s" Jun 02 16:41:21.379063 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.379034 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:21.397923 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.397889 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:21.417143 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:21.417102 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750685bd4b4365c66e32e39d3b8c8a62.slice/crio-f6d01fb6a45e17930a3fea4dd1b88b6901f3bd24f83a882c19feb561640e2836 WatchSource:0}: Error finding container f6d01fb6a45e17930a3fea4dd1b88b6901f3bd24f83a882c19feb561640e2836: Status 404 returned error can't find the container with id f6d01fb6a45e17930a3fea4dd1b88b6901f3bd24f83a882c19feb561640e2836 Jun 02 16:41:21.417339 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:21.417318 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621d7a745586b141902a7d8439613a76.slice/crio-50b850e57771d094cd68f0bf4305cd64b4f77e618a7362f2da7b9555d43cc03d WatchSource:0}: Error finding container 50b850e57771d094cd68f0bf4305cd64b4f77e618a7362f2da7b9555d43cc03d: Status 404 returned error can't find the container with id 50b850e57771d094cd68f0bf4305cd64b4f77e618a7362f2da7b9555d43cc03d Jun 02 16:41:21.419846 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.419811 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4mgts" Jun 02 16:41:21.420444 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.420430 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:41:21.428076 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.428060 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4mgts" Jun 02 16:41:21.462994 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.462957 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.495482 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.495435 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" event={"ID":"750685bd4b4365c66e32e39d3b8c8a62","Type":"ContainerStarted","Data":"f6d01fb6a45e17930a3fea4dd1b88b6901f3bd24f83a882c19feb561640e2836"} Jun 02 16:41:21.496322 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.496302 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" event={"ID":"621d7a745586b141902a7d8439613a76","Type":"ContainerStarted","Data":"50b850e57771d094cd68f0bf4305cd64b4f77e618a7362f2da7b9555d43cc03d"} Jun 02 16:41:21.563537 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.563491 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.664314 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.663992 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.764546 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.764506 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.865345 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:21.865307 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-40.ec2.internal\" not found" Jun 02 16:41:21.886763 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.886583 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:21.980118 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.980089 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" Jun 02 16:41:21.992470 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.992421 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:21.993619 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:21.993594 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" Jun 02 16:41:22.002546 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.002524 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:22.174270 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.174242 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:22.335550 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.335473 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:22.348675 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.348652 2565 apiserver.go:52] "Watching apiserver" Jun 02 16:41:22.355386 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.355363 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 16:41:22.356607 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.356576 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal","openshift-dns/node-resolver-t5ml9","openshift-image-registry/node-ca-wv4p5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal","openshift-multus/multus-2rlsk","openshift-multus/multus-additional-cni-plugins-87l8s","openshift-network-operator/iptables-alerter-wjw6s","openshift-ovn-kubernetes/ovnkube-node-l7zkw","kube-system/konnectivity-agent-6n9lj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m","openshift-cluster-node-tuning-operator/tuned-z2glp","openshift-multus/network-metrics-daemon-gzznp","openshift-network-diagnostics/network-check-target-qrg4v"] Jun 02 16:41:22.357890 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.357869 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.359694 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.359665 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.360436 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.360408 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 16:41:22.360652 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.360633 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.360797 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.360777 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.360797 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.360795 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.360873 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.360847 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s276\"" Jun 02 16:41:22.361882 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.361865 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.362511 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.362121 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.362511 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.362384 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76rfd\"" Jun 02 16:41:22.362708 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.362691 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.363059 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.363043 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 16:41:22.363144 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.363083 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.363852 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.363836 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 16:41:22.364156 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.364066 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.364253 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.364181 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49tn4\"" Jun 02 16:41:22.364574 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.364557 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.364955 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.364936 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.365707 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.365335 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.365707 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.365520 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xwzzd\"" Jun 02 16:41:22.365707 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.365617 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 16:41:22.366320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.366302 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.366396 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.366309 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 16:41:22.366868 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.366482 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.366868 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.366509 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kjf4\"" Jun 02 16:41:22.366868 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.366686 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 16:41:22.367441 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.367424 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.368298 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368279 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.368601 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368579 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.369491 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368806 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 16:41:22.369491 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368876 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 16:41:22.369491 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368889 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.369491 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.368889 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.370488 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.370460 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 16:41:22.370583 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.370496 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.371049 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.371032 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6jxj7\"" Jun 02 16:41:22.371137 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.371120 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q44vt\"" Jun 02 16:41:22.371217 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.371202 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 16:41:22.371487 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.371470 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 16:41:22.371999 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.371982 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sg5dx\"" Jun 02 16:41:22.372225 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.372209 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.372298 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.372225 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:22.372298 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.372227 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 16:41:22.372395 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.372364 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:22.372620 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.372571 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:22.372782 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.372763 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxgbl\"" Jun 02 16:41:22.373120 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.372456 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:22.373511 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.373492 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:22.374509 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.374445 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 16:41:22.380144 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.380130 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 16:41:22.389565 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-kubernetes\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.389662 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.389662 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.389662 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-var-lib-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389686 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-serviceca\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-os-release\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-netd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-sys-fs\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.389833 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-bin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8h46\" (UniqueName: \"kubernetes.io/projected/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-kube-api-access-v8h46\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsg6\" (UniqueName: \"kubernetes.io/projected/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-kube-api-access-6wsg6\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2wz\" (UniqueName: \"kubernetes.io/projected/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kube-api-access-2b2wz\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef1c1870-e55a-403c-b648-350b15a81e14-iptables-alerter-script\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-var-lib-kubelet\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.389992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-bin\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn2jz\" (UniqueName: \"kubernetes.io/projected/eab04f4a-be4a-4535-86d8-aedc1b7ed389-kube-api-access-kn2jz\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf40f-998c-4cf6-bc40-6708f9ee9823-tmp-dir\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-cnibin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-k8s-cni-cncf-io\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-conf\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-tmp\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-socket-dir-parent\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-system-cni-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-systemd-units\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-slash\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-systemd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-script-lib\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-registration-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-device-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-kube-api-access-sbwxk\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-daemon-config\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-etc-kubernetes\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.390594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef1c1870-e55a-403c-b648-350b15a81e14-host-slash\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-config\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-env-overrides\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-lib-modules\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-tuned\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-kubelet\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq28j\" (UniqueName: \"kubernetes.io/projected/ef1c1870-e55a-403c-b648-350b15a81e14-kube-api-access-qq28j\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-modprobe-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cnibin\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5gv\" (UniqueName: \"kubernetes.io/projected/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-kube-api-access-8q5gv\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-netns\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-etc-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-log-socket\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.391324 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-socket-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-hostroot\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-multus-certs\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.390983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5bhb\" (UniqueName: \"kubernetes.io/projected/3f84be35-645d-4f91-9e1b-fcba46088cef-kube-api-access-n5bhb\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysconfig\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-systemd\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-host\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-host\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f011d3c-60fe-4624-95d0-e650b2d21c3b-agent-certs\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-multus\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-run\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-kubelet\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8efbf40f-998c-4cf6-bc40-6708f9ee9823-hosts-file\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-system-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-os-release\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.392012 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-cni-binary-copy\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-netns\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-sys\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54sfc\" (UniqueName: \"kubernetes.io/projected/8efbf40f-998c-4cf6-bc40-6708f9ee9823-kube-api-access-54sfc\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-conf-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-node-log\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f011d3c-60fe-4624-95d0-e650b2d21c3b-konnectivity-ca\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-ovn\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.392610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.391577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.429494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.429466 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:21 +0000 UTC" deadline="2027-12-14 04:59:13.322503891 +0000 UTC" Jun 02 16:41:22.429494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.429490 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13428h17m50.893015649s" Jun 02 16:41:22.492017 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.491978 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-kubelet\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492024 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8efbf40f-998c-4cf6-bc40-6708f9ee9823-hosts-file\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492050 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-system-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492074 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-os-release\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492099 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-kubelet\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492123 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-cni-binary-copy\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492149 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-netns\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492172 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-sys\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-os-release\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492188 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-system-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492197 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54sfc\" (UniqueName: \"kubernetes.io/projected/8efbf40f-998c-4cf6-bc40-6708f9ee9823-kube-api-access-54sfc\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8efbf40f-998c-4cf6-bc40-6708f9ee9823-hosts-file\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-conf-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492284 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-node-log\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492312 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f011d3c-60fe-4624-95d0-e650b2d21c3b-konnectivity-ca\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492338 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492365 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-ovn\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492381 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492404 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492441 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-kubernetes\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492487 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-netns\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492513 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-var-lib-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492534 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-serviceca\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-sys\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492562 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-os-release\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.492672 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492582 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-netd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492609 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492633 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-sys-fs\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492657 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-bin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492688 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8h46\" (UniqueName: \"kubernetes.io/projected/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-kube-api-access-v8h46\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492711 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsg6\" (UniqueName: \"kubernetes.io/projected/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-kube-api-access-6wsg6\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492735 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2wz\" (UniqueName: \"kubernetes.io/projected/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kube-api-access-2b2wz\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492775 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef1c1870-e55a-403c-b648-350b15a81e14-iptables-alerter-script\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492800 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-var-lib-kubelet\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-cni-binary-copy\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492823 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-bin\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492849 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn2jz\" (UniqueName: \"kubernetes.io/projected/eab04f4a-be4a-4535-86d8-aedc1b7ed389-kube-api-access-kn2jz\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492873 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492888 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf40f-998c-4cf6-bc40-6708f9ee9823-tmp-dir\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492886 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492904 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-cnibin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492926 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-k8s-cni-cncf-io\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.493432 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-conf\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492975 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-tmp\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.492990 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-socket-dir-parent\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493009 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493031 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-system-cni-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493057 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-systemd-units\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493073 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-slash\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493099 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-systemd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493121 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493149 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-script-lib\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493166 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-registration-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493190 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-device-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493219 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-kube-api-access-sbwxk\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493244 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-daemon-config\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493268 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-etc-kubernetes\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493293 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef1c1870-e55a-403c-b648-350b15a81e14-host-slash\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493312 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-config\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493336 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-env-overrides\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493364 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-lib-modules\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493390 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-tuned\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493406 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493428 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-kubelet\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493456 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq28j\" (UniqueName: \"kubernetes.io/projected/ef1c1870-e55a-403c-b648-350b15a81e14-kube-api-access-qq28j\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493483 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-modprobe-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-ovn\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cnibin\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-conf-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493537 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5gv\" (UniqueName: \"kubernetes.io/projected/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-kube-api-access-8q5gv\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493559 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-netns\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493576 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-etc-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f011d3c-60fe-4624-95d0-e650b2d21c3b-konnectivity-ca\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493600 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-log-socket\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493631 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.494733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493649 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-node-log\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493670 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493691 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-socket-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493707 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-hostroot\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493725 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-multus-certs\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493780 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5bhb\" (UniqueName: \"kubernetes.io/projected/3f84be35-645d-4f91-9e1b-fcba46088cef-kube-api-access-n5bhb\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493800 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysconfig\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493815 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-systemd\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493831 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-host\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493846 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-host\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493876 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f011d3c-60fe-4624-95d0-e650b2d21c3b-agent-certs\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493912 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-multus\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.493937 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-run\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-run\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-config\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-system-cni-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.495269 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-cni-dir\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494459 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-kubernetes\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494508 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-systemd-units\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494560 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-device-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-slash\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-env-overrides\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-systemd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef1c1870-e55a-403c-b648-350b15a81e14-host-slash\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-registration-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-var-lib-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.494790 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-socket-dir-parent\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-os-release\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.495145 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-serviceca\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.496323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-sys-fs\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.495231 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:22.995192608 +0000 UTC m=+3.107746471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-bin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-netd\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-lib-modules\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cnibin\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495914 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-run-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495960 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-kubelet\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.495984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efbf40f-998c-4cf6-bc40-6708f9ee9823-tmp-dir\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-cnibin\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-k8s-cni-cncf-io\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysctl-conf\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef1c1870-e55a-403c-b648-350b15a81e14-iptables-alerter-script\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-run-netns\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.497130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-var-lib-kubelet\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-host-cni-bin\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496482 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-etc-openvswitch\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-etc-kubernetes\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-socket-dir\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-sysconfig\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovnkube-script-lib\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-systemd\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-ovn-node-metrics-cert\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-tmp\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496914 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-host\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.496964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-host\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-log-socket\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-var-lib-cni-multus\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497062 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-host-run-multus-certs\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f84be35-645d-4f91-9e1b-fcba46088cef-hostroot\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497127 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-modprobe-d\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.497870 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497518 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f84be35-645d-4f91-9e1b-fcba46088cef-multus-daemon-config\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.498665 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.497862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-etc-tuned\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.499813 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.499709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f011d3c-60fe-4624-95d0-e650b2d21c3b-agent-certs\") pod \"konnectivity-agent-6n9lj\" (UID: \"7f011d3c-60fe-4624-95d0-e650b2d21c3b\") " pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.500175 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.500153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54sfc\" (UniqueName: \"kubernetes.io/projected/8efbf40f-998c-4cf6-bc40-6708f9ee9823-kube-api-access-54sfc\") pod \"node-resolver-t5ml9\" (UID: \"8efbf40f-998c-4cf6-bc40-6708f9ee9823\") " pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.502489 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.502474 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:22.502579 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.502493 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:22.502579 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.502505 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:22.502579 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.502563 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:23.002544546 +0000 UTC m=+3.115098389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:22.504932 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.504907 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5bhb\" (UniqueName: \"kubernetes.io/projected/3f84be35-645d-4f91-9e1b-fcba46088cef-kube-api-access-n5bhb\") pod \"multus-2rlsk\" (UID: \"3f84be35-645d-4f91-9e1b-fcba46088cef\") " pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.505457 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.505265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8h46\" (UniqueName: \"kubernetes.io/projected/f83da9f6-1de2-42d6-bd98-d6e6e9b09616-kube-api-access-v8h46\") pod \"tuned-z2glp\" (UID: \"f83da9f6-1de2-42d6-bd98-d6e6e9b09616\") " pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.506519 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.506497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/4aeaa789-664b-43a5-bd66-6de2a4c12eeb-kube-api-access-sbwxk\") pod \"node-ca-wv4p5\" (UID: \"4aeaa789-664b-43a5-bd66-6de2a4c12eeb\") " pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.507825 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.507804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq28j\" (UniqueName: \"kubernetes.io/projected/ef1c1870-e55a-403c-b648-350b15a81e14-kube-api-access-qq28j\") pod \"iptables-alerter-wjw6s\" (UID: \"ef1c1870-e55a-403c-b648-350b15a81e14\") " pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.508482 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.508451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsg6\" (UniqueName: \"kubernetes.io/projected/a9c9b1e4-5048-4040-91cb-034f0ec7f3b9-kube-api-access-6wsg6\") pod \"ovnkube-node-l7zkw\" (UID: \"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.508482 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.508479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2wz\" (UniqueName: \"kubernetes.io/projected/3eef0a0a-e17c-40c6-9f3b-1020be40bba0-kube-api-access-2b2wz\") pod \"aws-ebs-csi-driver-node-zm49m\" (UID: \"3eef0a0a-e17c-40c6-9f3b-1020be40bba0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.508989 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.508968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn2jz\" (UniqueName: \"kubernetes.io/projected/eab04f4a-be4a-4535-86d8-aedc1b7ed389-kube-api-access-kn2jz\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.509895 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.509876 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5gv\" (UniqueName: \"kubernetes.io/projected/f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1-kube-api-access-8q5gv\") pod \"multus-additional-cni-plugins-87l8s\" (UID: \"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1\") " pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.669050 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.668971 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" Jun 02 16:41:22.676850 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.676826 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5ml9" Jun 02 16:41:22.683193 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.683171 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rlsk" Jun 02 16:41:22.688848 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.688820 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wv4p5" Jun 02 16:41:22.695447 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.695429 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87l8s" Jun 02 16:41:22.704558 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.704539 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjw6s" Jun 02 16:41:22.710098 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.710068 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:22.717673 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.717655 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:22.722221 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.722205 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z2glp" Jun 02 16:41:22.944995 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.944970 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1c1870_e55a_403c_b648_350b15a81e14.slice/crio-d2259765b86f6e931ec37e13b478802921ed3d49c5dec38a95b981403e4d6e90 WatchSource:0}: Error finding container d2259765b86f6e931ec37e13b478802921ed3d49c5dec38a95b981403e4d6e90: Status 404 returned error can't find the container with id d2259765b86f6e931ec37e13b478802921ed3d49c5dec38a95b981403e4d6e90 Jun 02 16:41:22.947389 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.947361 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83da9f6_1de2_42d6_bd98_d6e6e9b09616.slice/crio-6ba4f3a589bcb5b571de704653d6d268fc8f37ba3cb3b08a34e08395885affae WatchSource:0}: Error finding container 6ba4f3a589bcb5b571de704653d6d268fc8f37ba3cb3b08a34e08395885affae: Status 404 returned error can't find the container with id 6ba4f3a589bcb5b571de704653d6d268fc8f37ba3cb3b08a34e08395885affae Jun 02 16:41:22.948365 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.948145 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f84be35_645d_4f91_9e1b_fcba46088cef.slice/crio-25a9e9b6af5041b712b7f1bdf2c33e6bcb4dd285c524a23992fd4dd44022be57 WatchSource:0}: Error finding container 25a9e9b6af5041b712b7f1bdf2c33e6bcb4dd285c524a23992fd4dd44022be57: Status 404 returned error can't find the container with id 25a9e9b6af5041b712b7f1bdf2c33e6bcb4dd285c524a23992fd4dd44022be57 Jun 02 16:41:22.949701 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.949594 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c9b1e4_5048_4040_91cb_034f0ec7f3b9.slice/crio-69d211f32fbba6f12ffa081fdd742840cec03bf7418bae552152b86bb16948a0 WatchSource:0}: Error finding container 69d211f32fbba6f12ffa081fdd742840cec03bf7418bae552152b86bb16948a0: Status 404 returned error can't find the container with id 69d211f32fbba6f12ffa081fdd742840cec03bf7418bae552152b86bb16948a0 Jun 02 16:41:22.951807 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.951778 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f011d3c_60fe_4624_95d0_e650b2d21c3b.slice/crio-0d7a37e8c1ac1fbf182f4acba3b44bbaea8155852883a9e3a8df2b6df893c29a WatchSource:0}: Error finding container 0d7a37e8c1ac1fbf182f4acba3b44bbaea8155852883a9e3a8df2b6df893c29a: Status 404 returned error can't find the container with id 0d7a37e8c1ac1fbf182f4acba3b44bbaea8155852883a9e3a8df2b6df893c29a Jun 02 16:41:22.952912 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.952891 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aeaa789_664b_43a5_bd66_6de2a4c12eeb.slice/crio-0ad34c11e7bd61f110797ff2f1b96440647b3af18d4d5a2397c6d3cbc186a197 WatchSource:0}: Error finding container 0ad34c11e7bd61f110797ff2f1b96440647b3af18d4d5a2397c6d3cbc186a197: Status 404 returned error can't find the container with id 0ad34c11e7bd61f110797ff2f1b96440647b3af18d4d5a2397c6d3cbc186a197 Jun 02 16:41:22.954049 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.954027 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efbf40f_998c_4cf6_bc40_6708f9ee9823.slice/crio-9d4a9f6c1fa25201319e52c0c3206f4a1b97f1ecc857fa18e2ea805ec9ebca2f WatchSource:0}: Error finding container 9d4a9f6c1fa25201319e52c0c3206f4a1b97f1ecc857fa18e2ea805ec9ebca2f: Status 404 returned error can't find the container with id 9d4a9f6c1fa25201319e52c0c3206f4a1b97f1ecc857fa18e2ea805ec9ebca2f Jun 02 16:41:22.955684 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.955383 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eef0a0a_e17c_40c6_9f3b_1020be40bba0.slice/crio-c2355eb4e5c8e43c03384537a2f62289e24a1d6a14bcbd54e6a5b495b9ba3125 WatchSource:0}: Error finding container c2355eb4e5c8e43c03384537a2f62289e24a1d6a14bcbd54e6a5b495b9ba3125: Status 404 returned error can't find the container with id c2355eb4e5c8e43c03384537a2f62289e24a1d6a14bcbd54e6a5b495b9ba3125 Jun 02 16:41:22.956213 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:41:22.956194 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93a7d2d_ca4c_4224_a13c_4935ccd7cfc1.slice/crio-793ee725f95e3169cf67a6dc15e025bdf04230b26326e796a19b048fda6f3b08 WatchSource:0}: Error finding container 793ee725f95e3169cf67a6dc15e025bdf04230b26326e796a19b048fda6f3b08: Status 404 returned error can't find the container with id 793ee725f95e3169cf67a6dc15e025bdf04230b26326e796a19b048fda6f3b08 Jun 02 16:41:22.997772 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:22.997615 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:22.997772 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.997766 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:22.997896 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:22.997821 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:23.997808429 +0000 UTC m=+4.110362274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:23.099002 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.098971 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:23.099157 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:23.099140 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:23.099203 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:23.099159 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:23.099203 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:23.099170 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:23.099276 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:23.099220 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:24.099206408 +0000 UTC m=+4.211760250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:23.430280 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.430229 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:21 +0000 UTC" deadline="2028-03-04 05:53:00.344618314 +0000 UTC" Jun 02 16:41:23.430280 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.430271 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15373h11m36.914350782s" Jun 02 16:41:23.492717 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.492677 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:23.492927 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:23.492891 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:23.539065 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.538986 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6n9lj" event={"ID":"7f011d3c-60fe-4624-95d0-e650b2d21c3b","Type":"ContainerStarted","Data":"0d7a37e8c1ac1fbf182f4acba3b44bbaea8155852883a9e3a8df2b6df893c29a"} Jun 02 16:41:23.550962 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.550881 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z2glp" event={"ID":"f83da9f6-1de2-42d6-bd98-d6e6e9b09616","Type":"ContainerStarted","Data":"6ba4f3a589bcb5b571de704653d6d268fc8f37ba3cb3b08a34e08395885affae"} Jun 02 16:41:23.566645 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.566610 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"69d211f32fbba6f12ffa081fdd742840cec03bf7418bae552152b86bb16948a0"} Jun 02 16:41:23.570899 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.570837 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rlsk" event={"ID":"3f84be35-645d-4f91-9e1b-fcba46088cef","Type":"ContainerStarted","Data":"25a9e9b6af5041b712b7f1bdf2c33e6bcb4dd285c524a23992fd4dd44022be57"} Jun 02 16:41:23.578173 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.578115 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjw6s" event={"ID":"ef1c1870-e55a-403c-b648-350b15a81e14","Type":"ContainerStarted","Data":"d2259765b86f6e931ec37e13b478802921ed3d49c5dec38a95b981403e4d6e90"} Jun 02 16:41:23.602376 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.601652 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" event={"ID":"750685bd4b4365c66e32e39d3b8c8a62","Type":"ContainerStarted","Data":"b71a6290ad0dd12592cfd7808eb001ed29515578af5c3638d238bef856ea840c"} Jun 02 16:41:23.618992 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.618945 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerStarted","Data":"793ee725f95e3169cf67a6dc15e025bdf04230b26326e796a19b048fda6f3b08"} Jun 02 16:41:23.626550 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.626496 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5ml9" event={"ID":"8efbf40f-998c-4cf6-bc40-6708f9ee9823","Type":"ContainerStarted","Data":"9d4a9f6c1fa25201319e52c0c3206f4a1b97f1ecc857fa18e2ea805ec9ebca2f"} Jun 02 16:41:23.629774 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.629700 2565 generic.go:358] "Generic (PLEG): container finished" podID="621d7a745586b141902a7d8439613a76" containerID="d12fb50a372b4b7afe880a81a8ca7001db95cbbfe23218468880dbef8eeb2ddf" exitCode=0 Jun 02 16:41:23.629903 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.629780 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" event={"ID":"621d7a745586b141902a7d8439613a76","Type":"ContainerDied","Data":"d12fb50a372b4b7afe880a81a8ca7001db95cbbfe23218468880dbef8eeb2ddf"} Jun 02 16:41:23.646263 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.645362 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-40.ec2.internal" podStartSLOduration=2.6453441570000003 podStartE2EDuration="2.645344157s" podCreationTimestamp="2026-06-02 16:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:23.617858131 +0000 UTC m=+3.730411995" watchObservedRunningTime="2026-06-02 16:41:23.645344157 +0000 UTC m=+3.757898011" Jun 02 16:41:23.647707 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.647682 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" event={"ID":"3eef0a0a-e17c-40c6-9f3b-1020be40bba0","Type":"ContainerStarted","Data":"c2355eb4e5c8e43c03384537a2f62289e24a1d6a14bcbd54e6a5b495b9ba3125"} Jun 02 16:41:23.665862 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:23.662406 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wv4p5" event={"ID":"4aeaa789-664b-43a5-bd66-6de2a4c12eeb","Type":"ContainerStarted","Data":"0ad34c11e7bd61f110797ff2f1b96440647b3af18d4d5a2397c6d3cbc186a197"} Jun 02 16:41:24.006106 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:24.006069 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:24.006331 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.006213 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:24.006331 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.006280 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:26.006261527 +0000 UTC m=+6.118815384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:24.107973 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:24.107213 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:24.107973 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.107447 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:24.107973 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.107469 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:24.107973 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.107481 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:24.107973 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.107543 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:26.107524068 +0000 UTC m=+6.220077935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:24.472132 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:24.471813 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:24.492574 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:24.492539 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:24.492777 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:24.492675 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:24.685084 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:24.685036 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" event={"ID":"621d7a745586b141902a7d8439613a76","Type":"ContainerStarted","Data":"3e62015670171c60a06cd5ba90424b14d8b299d0520554ebfe7f55272bc1f20f"} Jun 02 16:41:25.492506 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:25.492434 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:25.493120 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:25.492569 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:26.025725 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:26.025186 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:26.025725 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.025329 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:26.025725 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.025384 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:30.025370577 +0000 UTC m=+10.137924419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:26.126161 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:26.126118 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:26.126432 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.126408 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:26.126511 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.126438 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:26.126511 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.126453 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:26.126624 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.126519 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:30.12649854 +0000 UTC m=+10.239052396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:26.496735 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:26.496702 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:26.497170 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:26.496848 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:27.492224 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:27.492189 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:27.492405 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:27.492353 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:28.493946 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:28.493915 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:28.494326 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:28.494018 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:29.492668 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:29.492635 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:29.492853 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:29.492803 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:30.061695 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:30.061658 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:30.062127 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.061796 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:30.062127 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.061868 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:38.061849406 +0000 UTC m=+18.174403252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:30.162628 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:30.162579 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:30.162827 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.162787 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:30.162827 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.162810 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:30.162827 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.162822 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:30.162987 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.162891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:38.162871323 +0000 UTC m=+18.275425174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:30.493831 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:30.493805 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:30.494009 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:30.493905 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:31.492712 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:31.492215 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:31.492712 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:31.492345 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:32.492457 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:32.492420 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:32.492689 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:32.492553 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:33.492049 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:33.492014 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:33.492488 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:33.492128 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:34.492595 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:34.492556 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:34.493186 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:34.492681 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:35.493045 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:35.492990 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:35.495696 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:35.493136 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:36.495497 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:36.495467 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:36.495924 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:36.495593 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:37.492040 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:37.492001 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:37.492319 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:37.492134 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:38.116311 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:38.116272 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:38.116776 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.116444 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:38.116776 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.116522 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.116502971 +0000 UTC m=+34.229056826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:38.216953 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:38.216916 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:38.217139 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.217111 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:38.217139 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.217134 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:38.217252 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.217149 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:38.217252 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.217209 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.217193574 +0000 UTC m=+34.329747428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:38.492614 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:38.492578 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:38.492808 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:38.492699 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:39.492387 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:39.492346 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:39.492801 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:39.492462 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:40.493029 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:40.493002 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:40.493285 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:40.493122 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:41.492398 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.492169 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:41.492569 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:41.492542 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:41.718027 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.717817 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="b683c2b7da22ea18a60e1d62ed7df97f88ea1b53e4d358103a33ae247950bb29" exitCode=0 Jun 02 16:41:41.718798 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.717955 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"b683c2b7da22ea18a60e1d62ed7df97f88ea1b53e4d358103a33ae247950bb29"} Jun 02 16:41:41.720525 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.720498 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5ml9" event={"ID":"8efbf40f-998c-4cf6-bc40-6708f9ee9823","Type":"ContainerStarted","Data":"9a297293995ca1db3af0a7b245a182da9676cb171421d4f2efa54d3f6428a8de"} Jun 02 16:41:41.722944 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.722890 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" event={"ID":"3eef0a0a-e17c-40c6-9f3b-1020be40bba0","Type":"ContainerStarted","Data":"a7f4ed6b6ea0b9425402984c709aac9f64363d29a693be727a1159d4a4e13a0f"} Jun 02 16:41:41.724575 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.724555 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wv4p5" event={"ID":"4aeaa789-664b-43a5-bd66-6de2a4c12eeb","Type":"ContainerStarted","Data":"7db5d24d89de7cd0d1e76facc0b3914b157576573caacd04381a01db9fff6c43"} Jun 02 16:41:41.726302 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.726282 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6n9lj" event={"ID":"7f011d3c-60fe-4624-95d0-e650b2d21c3b","Type":"ContainerStarted","Data":"af128c185b7fde9a3b061cd6a187d3b7625c540fd4ac38820972a59f2f40b64d"} Jun 02 16:41:41.728249 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.728231 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z2glp" event={"ID":"f83da9f6-1de2-42d6-bd98-d6e6e9b09616","Type":"ContainerStarted","Data":"ee603057dd742b20157c341f180db19ef438f20234d416eb1b8c8148e11ae778"} Jun 02 16:41:41.732666 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.732604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733015 2565 generic.go:358] "Generic (PLEG): container finished" podID="a9c9b1e4-5048-4040-91cb-034f0ec7f3b9" containerID="cedbd6b1ea9ccf6a5ec4341e8ea0b5f8a4e7c8b41b3494746f418a7b197be94f" exitCode=1 Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733077 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"bddd722f9abf0ead440a14dceaa4926b26b02ba88f8a641822c805680f328703"} Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733093 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"5b9a04dcc5bb0b04618a94047a21654653cd8617980469b64366f7c8c6b6fa39"} Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733104 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"deb52ebbff25b221b015292f7e722ea42d60999325d32507d256e3c880a0f25d"} Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733113 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerDied","Data":"cedbd6b1ea9ccf6a5ec4341e8ea0b5f8a4e7c8b41b3494746f418a7b197be94f"} Jun 02 16:41:41.733157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.733128 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"48a8606ed48293ebcb480654ab3bdbc84adb574cdc7534492d6253ecd646ad54"} Jun 02 16:41:41.735472 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.735435 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rlsk" event={"ID":"3f84be35-645d-4f91-9e1b-fcba46088cef","Type":"ContainerStarted","Data":"60d9c5c7926cf5c3bafdae2ae2d0968989c8db50e9251a07a49ba72216906d11"} Jun 02 16:41:41.752600 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.752549 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-40.ec2.internal" podStartSLOduration=20.752534456 podStartE2EDuration="20.752534456s" podCreationTimestamp="2026-06-02 16:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:24.700400103 +0000 UTC m=+4.812953970" watchObservedRunningTime="2026-06-02 16:41:41.752534456 +0000 UTC m=+21.865088320" Jun 02 16:41:41.779124 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.779066 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2rlsk" podStartSLOduration=3.68074569 podStartE2EDuration="21.77905235s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.952671865 +0000 UTC m=+3.065225707" lastFinishedPulling="2026-06-02 16:41:41.050978523 +0000 UTC m=+21.163532367" observedRunningTime="2026-06-02 16:41:41.778943002 +0000 UTC m=+21.891496864" watchObservedRunningTime="2026-06-02 16:41:41.77905235 +0000 UTC m=+21.891606226" Jun 02 16:41:41.800386 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.800346 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wv4p5" podStartSLOduration=11.764457686 podStartE2EDuration="21.800334216s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.9556537 +0000 UTC m=+3.068207542" lastFinishedPulling="2026-06-02 16:41:32.991530217 +0000 UTC m=+13.104084072" observedRunningTime="2026-06-02 16:41:41.80015731 +0000 UTC m=+21.912711174" watchObservedRunningTime="2026-06-02 16:41:41.800334216 +0000 UTC m=+21.912888082" Jun 02 16:41:41.843708 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.843661 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5ml9" podStartSLOduration=3.764126642 podStartE2EDuration="21.843647499s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.957025092 +0000 UTC m=+3.069578933" lastFinishedPulling="2026-06-02 16:41:41.036545935 +0000 UTC m=+21.149099790" observedRunningTime="2026-06-02 16:41:41.843642954 +0000 UTC m=+21.956196816" watchObservedRunningTime="2026-06-02 16:41:41.843647499 +0000 UTC m=+21.956201361" Jun 02 16:41:41.844136 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.844113 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z2glp" podStartSLOduration=3.758628092 podStartE2EDuration="21.844107246s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.951085089 +0000 UTC m=+3.063638933" lastFinishedPulling="2026-06-02 16:41:41.036564246 +0000 UTC m=+21.149118087" observedRunningTime="2026-06-02 16:41:41.821879383 +0000 UTC m=+21.934433240" watchObservedRunningTime="2026-06-02 16:41:41.844107246 +0000 UTC m=+21.956661109" Jun 02 16:41:41.864773 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:41.864649 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6n9lj" podStartSLOduration=3.783664575 podStartE2EDuration="21.864634336s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.955574313 +0000 UTC m=+3.068128158" lastFinishedPulling="2026-06-02 16:41:41.036544072 +0000 UTC m=+21.149097919" observedRunningTime="2026-06-02 16:41:41.86441552 +0000 UTC m=+21.976969395" watchObservedRunningTime="2026-06-02 16:41:41.864634336 +0000 UTC m=+21.977188232" Jun 02 16:41:42.370928 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.370888 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 16:41:42.443741 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.443559 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T16:41:42.370908561Z","UUID":"19ec3705-f34b-4233-a998-9b9873fe45d0","Handler":null,"Name":"","Endpoint":""} Jun 02 16:41:42.445415 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.445395 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 16:41:42.445548 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.445422 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 16:41:42.495719 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.495696 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:42.495857 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:42.495807 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:42.739521 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.739491 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" event={"ID":"3eef0a0a-e17c-40c6-9f3b-1020be40bba0","Type":"ContainerStarted","Data":"a360299a0273eab280b626e84c51b66a9d20452d7a5444e00cc168e32f8bd8fb"} Jun 02 16:41:42.742201 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.742180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:41:42.742597 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.742574 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"6fcb73c1b76bf6dc88d3e3f510ebe5c003cde7ba269b861b1fae47cd05a56cf0"} Jun 02 16:41:42.743909 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.743882 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjw6s" event={"ID":"ef1c1870-e55a-403c-b648-350b15a81e14","Type":"ContainerStarted","Data":"bb71498427fd664fd81e59322abc29b46ff35daf6b713a7dbb903e4a0eb7161b"} Jun 02 16:41:42.761289 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:42.761241 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wjw6s" podStartSLOduration=4.671911545 podStartE2EDuration="22.76122814s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.947215188 +0000 UTC m=+3.059769029" lastFinishedPulling="2026-06-02 16:41:41.03653177 +0000 UTC m=+21.149085624" observedRunningTime="2026-06-02 16:41:42.761131253 +0000 UTC m=+22.873685117" watchObservedRunningTime="2026-06-02 16:41:42.76122814 +0000 UTC m=+22.873781985" Jun 02 16:41:43.492636 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:43.492467 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:43.492636 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:43.492601 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:43.747663 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:43.747624 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" event={"ID":"3eef0a0a-e17c-40c6-9f3b-1020be40bba0","Type":"ContainerStarted","Data":"18cf43fbbc2fa3ad594e8a2043238a41f490d049ff87aae8c5e486e99e05ee6a"} Jun 02 16:41:43.769228 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:43.769185 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm49m" podStartSLOduration=3.306358746 podStartE2EDuration="23.769169008s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.95880449 +0000 UTC m=+3.071358346" lastFinishedPulling="2026-06-02 16:41:43.421614753 +0000 UTC m=+23.534168608" observedRunningTime="2026-06-02 16:41:43.768775261 +0000 UTC m=+23.881329124" watchObservedRunningTime="2026-06-02 16:41:43.769169008 +0000 UTC m=+23.881722873" Jun 02 16:41:44.492203 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:44.492017 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:44.492388 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:44.492295 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:44.751973 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:44.751903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:41:44.752392 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:44.752271 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"d4ea5626d11105c5437f308c8841439280d3a26e8577983ab9d153d2bdb43fd4"} Jun 02 16:41:45.492917 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:45.492878 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:45.493129 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:45.493004 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:45.605836 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:45.605792 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:45.606560 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:45.606543 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:45.754938 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:45.754866 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:45.755460 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:45.755408 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6n9lj" Jun 02 16:41:46.492379 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.492199 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:46.492565 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:46.492478 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:46.759034 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.759011 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:41:46.759825 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.759435 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"6c2120cde9cc22b79571446a2361df86ec68f321fac9cfab4c24e31f9d87953e"} Jun 02 16:41:46.760698 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.760678 2565 scope.go:117] "RemoveContainer" containerID="cedbd6b1ea9ccf6a5ec4341e8ea0b5f8a4e7c8b41b3494746f418a7b197be94f" Jun 02 16:41:46.762081 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.761440 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:46.762081 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.761470 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:46.764164 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.764140 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="25e2e51f596c36eff1884d043e7979a16d1fb69c752553f181a8d86c95208ea5" exitCode=0 Jun 02 16:41:46.764274 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.764207 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"25e2e51f596c36eff1884d043e7979a16d1fb69c752553f181a8d86c95208ea5"} Jun 02 16:41:46.778361 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:46.778338 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:47.492849 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.492808 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:47.493024 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:47.492932 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:47.769347 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.769278 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:41:47.769729 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.769630 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" event={"ID":"a9c9b1e4-5048-4040-91cb-034f0ec7f3b9","Type":"ContainerStarted","Data":"4da65e251f5e025844ed7d9115a4550d0f189602a057f1d2da90cd81b4c68ea9"} Jun 02 16:41:47.769863 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.769848 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:47.785211 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.785188 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:41:47.799120 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:47.799084 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" podStartSLOduration=9.668761529 podStartE2EDuration="27.799072159s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.953116506 +0000 UTC m=+3.065670363" lastFinishedPulling="2026-06-02 16:41:41.083427146 +0000 UTC m=+21.195980993" observedRunningTime="2026-06-02 16:41:47.797741725 +0000 UTC m=+27.910295587" watchObservedRunningTime="2026-06-02 16:41:47.799072159 +0000 UTC m=+27.911626020" Jun 02 16:41:48.185715 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.185686 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzznp"] Jun 02 16:41:48.185938 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.185847 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:48.186001 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:48.185964 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:48.186365 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.186344 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qrg4v"] Jun 02 16:41:48.186468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.186455 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:48.186572 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:48.186549 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:48.773688 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.773651 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="9e492aa1aae43856bd0f020e47362fe8d99a1ea39701091023222ec260b265fb" exitCode=0 Jun 02 16:41:48.774158 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:48.773736 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"9e492aa1aae43856bd0f020e47362fe8d99a1ea39701091023222ec260b265fb"} Jun 02 16:41:49.493128 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:49.492950 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:49.493320 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:49.493203 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:50.492986 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:50.492957 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:50.493481 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:50.493049 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:50.779632 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:50.779593 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="56a474fc32ba6d4144cb9f1e86d4aedbe49984989a8c0705990b8880074161a6" exitCode=0 Jun 02 16:41:50.779792 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:50.779647 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"56a474fc32ba6d4144cb9f1e86d4aedbe49984989a8c0705990b8880074161a6"} Jun 02 16:41:51.492231 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:51.492197 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:51.492395 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:51.492320 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:52.492563 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:52.492523 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:52.493158 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:52.492683 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:41:53.492044 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:53.492012 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:53.492222 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:53.492121 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qrg4v" podUID="baa3e27a-33cf-4568-a628-6d1b7c5132e1" Jun 02 16:41:54.127353 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.127242 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:54.127798 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.127424 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:54.127798 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.127503 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:26.127480916 +0000 UTC m=+66.240034773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:54.185239 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.185215 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-40.ec2.internal" event="NodeReady" Jun 02 16:41:54.185381 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.185355 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 16:41:54.228203 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.228172 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:54.228368 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.228313 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:54.228368 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.228330 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:54.228368 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.228341 2565 projected.go:194] Error preparing data for projected volume kube-api-access-5wmhx for pod openshift-network-diagnostics/network-check-target-qrg4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:54.228534 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.228394 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx podName:baa3e27a-33cf-4568-a628-6d1b7c5132e1 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:26.228377813 +0000 UTC m=+66.340931664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5wmhx" (UniqueName: "kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx") pod "network-check-target-qrg4v" (UID: "baa3e27a-33cf-4568-a628-6d1b7c5132e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:54.231404 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.231379 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6xg92"] Jun 02 16:41:54.255902 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.255878 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bktm2"] Jun 02 16:41:54.256049 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.256033 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.260505 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.260483 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 16:41:54.260962 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.260939 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:41:54.261215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.261195 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 16:41:54.270970 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.270950 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xg92"] Jun 02 16:41:54.270970 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.270970 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bktm2"] Jun 02 16:41:54.271094 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.271069 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.273984 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.273800 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 16:41:54.273984 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.273828 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 16:41:54.273984 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.273851 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:41:54.274287 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.274266 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 16:41:54.329452 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.329419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgf4\" (UniqueName: \"kubernetes.io/projected/a2e4acac-b598-45f8-b0a8-24363746f93c-kube-api-access-pwgf4\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.329602 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.329469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.329602 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.329493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2e4acac-b598-45f8-b0a8-24363746f93c-tmp-dir\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.329602 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.329568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e4acac-b598-45f8-b0a8-24363746f93c-config-volume\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.430947 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.430990 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2e4acac-b598-45f8-b0a8-24363746f93c-tmp-dir\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431229 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.431094 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:54.431229 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.431170 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.931149056 +0000 UTC m=+35.043702931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:41:54.431229 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgwnr\" (UniqueName: \"kubernetes.io/projected/7901ac90-e2b8-473b-90bc-d15afdaf039e-kube-api-access-jgwnr\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.431409 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431252 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e4acac-b598-45f8-b0a8-24363746f93c-config-volume\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431409 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.431409 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431375 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgf4\" (UniqueName: \"kubernetes.io/projected/a2e4acac-b598-45f8-b0a8-24363746f93c-kube-api-access-pwgf4\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431409 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2e4acac-b598-45f8-b0a8-24363746f93c-tmp-dir\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.431786 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.431736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2e4acac-b598-45f8-b0a8-24363746f93c-config-volume\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.445214 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.445180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgf4\" (UniqueName: \"kubernetes.io/projected/a2e4acac-b598-45f8-b0a8-24363746f93c-kube-api-access-pwgf4\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.492854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.492824 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:41:54.495900 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.495881 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:41:54.496032 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.495883 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:41:54.532234 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.532209 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.532358 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.532308 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgwnr\" (UniqueName: \"kubernetes.io/projected/7901ac90-e2b8-473b-90bc-d15afdaf039e-kube-api-access-jgwnr\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.532414 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.532361 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:54.532463 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.532436 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:41:55.032405288 +0000 UTC m=+35.144959150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:41:54.541693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.541675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgwnr\" (UniqueName: \"kubernetes.io/projected/7901ac90-e2b8-473b-90bc-d15afdaf039e-kube-api-access-jgwnr\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:54.936014 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:54.935978 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:54.936175 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.936092 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:54.936175 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:54.936153 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:55.936133357 +0000 UTC m=+36.048687215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:41:55.036565 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.036529 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:55.036782 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:55.036702 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:55.036859 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:55.036812 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:41:56.036791633 +0000 UTC m=+36.149345486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:41:55.492323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.492289 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:41:55.495468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.495344 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:41:55.495468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.495357 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:41:55.496340 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.496323 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:41:55.944192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:55.944101 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:55.944341 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:55.944265 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:55.944341 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:55.944331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:41:57.944312141 +0000 UTC m=+38.056865994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:41:56.045556 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:56.045512 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:56.045793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:56.045741 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:56.045905 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:56.045889 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.045866368 +0000 UTC m=+38.158420227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:41:56.794538 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:56.794313 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerStarted","Data":"41cb284904640de1815d5e7bc6e6b0a54994a6ab92a535c534ecab70ba194b22"} Jun 02 16:41:57.798647 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:57.798619 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="41cb284904640de1815d5e7bc6e6b0a54994a6ab92a535c534ecab70ba194b22" exitCode=0 Jun 02 16:41:57.799018 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:57.798675 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"41cb284904640de1815d5e7bc6e6b0a54994a6ab92a535c534ecab70ba194b22"} Jun 02 16:41:57.960505 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:57.960470 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:41:57.960650 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:57.960629 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:57.960709 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:57.960697 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:01.960678933 +0000 UTC m=+42.073232789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:41:58.061693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:58.061609 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:41:58.061862 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:58.061769 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:58.061862 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:41:58.061831 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:42:02.061816588 +0000 UTC m=+42.174370433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:41:58.805295 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:58.805266 2565 generic.go:358] "Generic (PLEG): container finished" podID="f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1" containerID="91f4a3b64da624be03f72593bd65e7985911f4699118112910f157c8f6aabb43" exitCode=0 Jun 02 16:41:58.805657 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:58.805313 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerDied","Data":"91f4a3b64da624be03f72593bd65e7985911f4699118112910f157c8f6aabb43"} Jun 02 16:41:59.809420 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:59.809389 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87l8s" event={"ID":"f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1","Type":"ContainerStarted","Data":"779a8b7f7fc7faad96bf160a0dcc8378e8279a7b563276b047fca271320ca6c0"} Jun 02 16:41:59.834223 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:41:59.834174 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-87l8s" podStartSLOduration=6.280890691 podStartE2EDuration="39.834160877s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:22.958984927 +0000 UTC m=+3.071538770" lastFinishedPulling="2026-06-02 16:41:56.512255113 +0000 UTC m=+36.624808956" observedRunningTime="2026-06-02 16:41:59.832791726 +0000 UTC m=+39.945345589" watchObservedRunningTime="2026-06-02 16:41:59.834160877 +0000 UTC m=+39.946714740" Jun 02 16:42:01.987127 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:01.987093 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:42:01.987530 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:01.987262 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:01.987530 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:01.987358 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:09.987340784 +0000 UTC m=+50.099894626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:42:02.088288 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:02.088256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:42:02.088449 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:02.088428 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:02.088498 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:02.088489 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:42:10.088476138 +0000 UTC m=+50.201029984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:42:10.045548 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:10.045510 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:42:10.046093 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:10.045672 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:10.046093 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:10.045743 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:26.045724358 +0000 UTC m=+66.158278204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:42:10.146494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:10.146454 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:42:10.146659 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:10.146570 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:10.146659 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:10.146621 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:42:26.146607441 +0000 UTC m=+66.259161282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:42:19.787411 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:19.787383 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l7zkw" Jun 02 16:42:26.053014 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.052968 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:42:26.053413 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.053086 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:26.053413 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.053147 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:42:58.053133284 +0000 UTC m=+98.165687125 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:42:26.153983 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.153946 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:42:26.154141 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.154004 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:42:26.154141 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.154094 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:26.154215 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.154148 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:42:58.154133496 +0000 UTC m=+98.266687337 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:42:26.156869 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.156853 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:42:26.164459 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.164443 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:42:26.164517 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:26.164488 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:30.164475114 +0000 UTC m=+130.277028963 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : secret "metrics-daemon-secret" not found Jun 02 16:42:26.254864 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.254842 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:42:26.258077 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.258062 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:42:26.268886 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.268872 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:42:26.279952 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.279929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmhx\" (UniqueName: \"kubernetes.io/projected/baa3e27a-33cf-4568-a628-6d1b7c5132e1-kube-api-access-5wmhx\") pod \"network-check-target-qrg4v\" (UID: \"baa3e27a-33cf-4568-a628-6d1b7c5132e1\") " pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:42:26.406544 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.406479 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:42:26.412874 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.412854 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:42:26.545725 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.545696 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qrg4v"] Jun 02 16:42:26.549646 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:42:26.549620 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa3e27a_33cf_4568_a628_6d1b7c5132e1.slice/crio-7b36d4264739703948405732a1ca3ea11b475c477c03f87321b9b7690c407cd9 WatchSource:0}: Error finding container 7b36d4264739703948405732a1ca3ea11b475c477c03f87321b9b7690c407cd9: Status 404 returned error can't find the container with id 7b36d4264739703948405732a1ca3ea11b475c477c03f87321b9b7690c407cd9 Jun 02 16:42:26.859092 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:26.859060 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qrg4v" event={"ID":"baa3e27a-33cf-4568-a628-6d1b7c5132e1","Type":"ContainerStarted","Data":"7b36d4264739703948405732a1ca3ea11b475c477c03f87321b9b7690c407cd9"} Jun 02 16:42:29.865057 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:29.865020 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qrg4v" event={"ID":"baa3e27a-33cf-4568-a628-6d1b7c5132e1","Type":"ContainerStarted","Data":"337f0f7eda19794e79f55504efbc574cb9275b1d9d334dcf3eff33dfc575494d"} Jun 02 16:42:29.865430 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:29.865147 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:42:29.883255 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:29.883151 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qrg4v" podStartSLOduration=67.219122686 podStartE2EDuration="1m9.883137506s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:42:26.551345793 +0000 UTC m=+66.663899636" lastFinishedPulling="2026-06-02 16:42:29.215360612 +0000 UTC m=+69.327914456" observedRunningTime="2026-06-02 16:42:29.883089208 +0000 UTC m=+69.995643070" watchObservedRunningTime="2026-06-02 16:42:29.883137506 +0000 UTC m=+69.995691370" Jun 02 16:42:33.986362 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.986252 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85"] Jun 02 16:42:33.989038 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.989021 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:33.991950 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.991921 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 16:42:33.992037 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.991921 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 16:42:33.993107 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.993093 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 16:42:33.993247 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:33.993229 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 16:42:34.005796 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.005774 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85"] Jun 02 16:42:34.007374 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.007308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-klusterlet-config\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.007374 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.007356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ksrd\" (UniqueName: \"kubernetes.io/projected/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-kube-api-access-8ksrd\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.007520 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.007395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-tmp\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.108597 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.108563 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-klusterlet-config\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.108597 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.108598 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ksrd\" (UniqueName: \"kubernetes.io/projected/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-kube-api-access-8ksrd\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.108813 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.108641 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-tmp\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.109085 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.109066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-tmp\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.111153 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.111132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-klusterlet-config\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.119377 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.119357 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ksrd\" (UniqueName: \"kubernetes.io/projected/aefcd37c-8c89-4f1b-bdf0-4682c65f7b98-kube-api-access-8ksrd\") pod \"klusterlet-addon-workmgr-87cb8d4dd-wfp85\" (UID: \"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.297845 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.297760 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:34.435679 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.435645 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85"] Jun 02 16:42:34.439587 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:42:34.439563 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefcd37c_8c89_4f1b_bdf0_4682c65f7b98.slice/crio-38f8075941dfc36beaaed6186bdccf54869589e3e2a4babdefefbdcfcec19bb1 WatchSource:0}: Error finding container 38f8075941dfc36beaaed6186bdccf54869589e3e2a4babdefefbdcfcec19bb1: Status 404 returned error can't find the container with id 38f8075941dfc36beaaed6186bdccf54869589e3e2a4babdefefbdcfcec19bb1 Jun 02 16:42:34.875185 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:34.875155 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" event={"ID":"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98","Type":"ContainerStarted","Data":"38f8075941dfc36beaaed6186bdccf54869589e3e2a4babdefefbdcfcec19bb1"} Jun 02 16:42:38.885358 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:38.885319 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" event={"ID":"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98","Type":"ContainerStarted","Data":"a1b64afc6a5fe35af4942b5e7d4b3df7c74da0847dcd4199d25447b9e80c9a03"} Jun 02 16:42:38.885813 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:38.885554 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:38.887217 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:38.887195 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:42:38.909254 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:38.909214 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" podStartSLOduration=2.155109309 podStartE2EDuration="5.909202455s" podCreationTimestamp="2026-06-02 16:42:33 +0000 UTC" firstStartedPulling="2026-06-02 16:42:34.441298566 +0000 UTC m=+74.553852411" lastFinishedPulling="2026-06-02 16:42:38.195391709 +0000 UTC m=+78.307945557" observedRunningTime="2026-06-02 16:42:38.908372175 +0000 UTC m=+79.020926039" watchObservedRunningTime="2026-06-02 16:42:38.909202455 +0000 UTC m=+79.021756318" Jun 02 16:42:58.070667 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:58.070567 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:42:58.071080 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:58.070685 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:58.071080 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:58.070788 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.070771992 +0000 UTC m=+162.183325834 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:42:58.171237 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:42:58.171193 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:42:58.171334 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:58.171322 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:58.171404 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:42:58.171395 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.171382793 +0000 UTC m=+162.283936635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:43:00.869523 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:00.869494 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qrg4v" Jun 02 16:43:30.180567 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:30.180524 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:43:30.181076 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:30.180655 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:43:30.181076 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:30.180732 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs podName:eab04f4a-be4a-4535-86d8-aedc1b7ed389 nodeName:}" failed. No retries permitted until 2026-06-02 16:45:32.180714881 +0000 UTC m=+252.293268726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs") pod "network-metrics-daemon-gzznp" (UID: "eab04f4a-be4a-4535-86d8-aedc1b7ed389") : secret "metrics-daemon-secret" not found Jun 02 16:43:57.267067 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:57.267008 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6xg92" podUID="a2e4acac-b598-45f8-b0a8-24363746f93c" Jun 02 16:43:57.281281 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:57.281250 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-bktm2" podUID="7901ac90-e2b8-473b-90bc-d15afdaf039e" Jun 02 16:43:57.503023 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:57.502986 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gzznp" podUID="eab04f4a-be4a-4535-86d8-aedc1b7ed389" Jun 02 16:43:58.030378 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.030301 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xg92" Jun 02 16:43:58.958763 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.958719 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj"] Jun 02 16:43:58.961433 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.961418 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:58.964765 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.964577 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 16:43:58.967094 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.967069 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 16:43:58.967207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.967108 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 16:43:58.967207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.967120 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v89sc\"" Jun 02 16:43:58.967207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.967073 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 16:43:58.980619 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:58.980599 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj"] Jun 02 16:43:59.063645 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.063617 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg"] Jun 02 16:43:59.066540 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.066520 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8lvd5"] Jun 02 16:43:59.066676 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.066657 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.069023 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.069007 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr"] Jun 02 16:43:59.069150 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.069135 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.071487 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071455 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 16:43:59.071605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071492 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 16:43:59.071605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071595 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2dxqz\"" Jun 02 16:43:59.071714 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071698 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh"] Jun 02 16:43:59.071828 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071811 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.071906 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071890 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 16:43:59.071961 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071945 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 16:43:59.072013 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071890 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:43:59.072059 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071891 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5ghwz\"" Jun 02 16:43:59.072059 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.071896 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 16:43:59.072729 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.072551 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 16:43:59.072729 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.072580 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 16:43:59.074818 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.074805 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.075381 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.075362 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 16:43:59.075506 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.075477 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:43:59.075592 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.075574 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjxvp\"" Jun 02 16:43:59.075834 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.075820 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 16:43:59.077486 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.077467 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 16:43:59.077577 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.077491 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 16:43:59.077577 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.077498 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:43:59.077776 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.077741 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 16:43:59.077836 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.077786 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7hs26\"" Jun 02 16:43:59.079414 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.079380 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 16:43:59.082541 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.082524 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg"] Jun 02 16:43:59.083874 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.083477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw474\" (UniqueName: \"kubernetes.io/projected/cdd37660-0c52-417b-9a94-deb92a3d9ece-kube-api-access-nw474\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.083874 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.083585 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh"] Jun 02 16:43:59.083874 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.083709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdd37660-0c52-417b-9a94-deb92a3d9ece-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.083874 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.083781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.084392 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.084374 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8lvd5"] Jun 02 16:43:59.085368 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.085349 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr"] Jun 02 16:43:59.166829 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.166793 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:43:59.169840 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.169821 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.172545 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.172522 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 16:43:59.172545 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.172561 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 16:43:59.172733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.172606 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 16:43:59.172733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.172698 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2fzdf\"" Jun 02 16:43:59.177719 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.177697 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 16:43:59.183488 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.183469 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:43:59.184693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-snapshots\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.184765 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.184765 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsggz\" (UniqueName: \"kubernetes.io/projected/2f91ec6a-e48c-4374-8456-e2548bde1905-kube-api-access-jsggz\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.184940 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.184940 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81d66c7d-2e7e-465c-87e9-a4f441f6b389-config\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.184940 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l86p8\" (UniqueName: \"kubernetes.io/projected/81d66c7d-2e7e-465c-87e9-a4f441f6b389-kube-api-access-l86p8\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e22f70a-683a-4661-9351-beb92358b034-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-service-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.184997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sql2n\" (UniqueName: \"kubernetes.io/projected/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-kube-api-access-sql2n\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-tmp\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185062 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdd37660-0c52-417b-9a94-deb92a3d9ece-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-serving-cert\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.185152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e22f70a-683a-4661-9351-beb92358b034-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185165 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81d66c7d-2e7e-465c-87e9-a4f441f6b389-serving-cert\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjtw\" (UniqueName: \"kubernetes.io/projected/7e22f70a-683a-4661-9351-beb92358b034-kube-api-access-dbjtw\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185264 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw474\" (UniqueName: \"kubernetes.io/projected/cdd37660-0c52-417b-9a94-deb92a3d9ece-kube-api-access-nw474\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.185296 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:43:59.185436 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.185377 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:43:59.685354165 +0000 UTC m=+159.797908007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:43:59.185687 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.185671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cdd37660-0c52-417b-9a94-deb92a3d9ece-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.202039 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.202017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw474\" (UniqueName: \"kubernetes.io/projected/cdd37660-0c52-417b-9a94-deb92a3d9ece-kube-api-access-nw474\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.286524 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286423 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l86p8\" (UniqueName: \"kubernetes.io/projected/81d66c7d-2e7e-465c-87e9-a4f441f6b389-kube-api-access-l86p8\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.286524 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl65z\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.286524 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286489 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sql2n\" (UniqueName: \"kubernetes.io/projected/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-kube-api-access-sql2n\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.286524 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286507 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-tmp\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286581 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjtw\" (UniqueName: \"kubernetes.io/projected/7e22f70a-683a-4661-9351-beb92358b034-kube-api-access-dbjtw\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286636 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e22f70a-683a-4661-9351-beb92358b034-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286721 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsggz\" (UniqueName: \"kubernetes.io/projected/2f91ec6a-e48c-4374-8456-e2548bde1905-kube-api-access-jsggz\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286776 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286810 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81d66c7d-2e7e-465c-87e9-a4f441f6b389-config\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286835 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-service-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.286880 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-tmp\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286951 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-serving-cert\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.286980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e22f70a-683a-4661-9351-beb92358b034-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287053 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81d66c7d-2e7e-465c-87e9-a4f441f6b389-serving-cert\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287172 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-snapshots\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287241 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.287352 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 16:43:59.287490 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.287446 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls podName:2f91ec6a-e48c-4374-8456-e2548bde1905 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:59.787410716 +0000 UTC m=+159.899964559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-lbxcr" (UID: "2f91ec6a-e48c-4374-8456-e2548bde1905") : secret "samples-operator-tls" not found Jun 02 16:43:59.288319 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81d66c7d-2e7e-465c-87e9-a4f441f6b389-config\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.288319 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e22f70a-683a-4661-9351-beb92358b034-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.288319 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-service-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.288319 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.287742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.288319 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.288023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-snapshots\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.289207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.289173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e22f70a-683a-4661-9351-beb92358b034-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.289646 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.289628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-serving-cert\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.289885 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.289866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81d66c7d-2e7e-465c-87e9-a4f441f6b389-serving-cert\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.296346 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.296320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l86p8\" (UniqueName: \"kubernetes.io/projected/81d66c7d-2e7e-465c-87e9-a4f441f6b389-kube-api-access-l86p8\") pod \"service-ca-operator-69877444c-z7rpg\" (UID: \"81d66c7d-2e7e-465c-87e9-a4f441f6b389\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.296456 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.296322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjtw\" (UniqueName: \"kubernetes.io/projected/7e22f70a-683a-4661-9351-beb92358b034-kube-api-access-dbjtw\") pod \"kube-storage-version-migrator-operator-96ddc787c-sltlh\" (UID: \"7e22f70a-683a-4661-9351-beb92358b034\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.296971 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.296945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sql2n\" (UniqueName: \"kubernetes.io/projected/5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb-kube-api-access-sql2n\") pod \"insights-operator-788bf58df5-8lvd5\" (UID: \"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb\") " pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.297049 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.297014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsggz\" (UniqueName: \"kubernetes.io/projected/2f91ec6a-e48c-4374-8456-e2548bde1905-kube-api-access-jsggz\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.376692 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.376660 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" Jun 02 16:43:59.383460 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.383418 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" Jun 02 16:43:59.388307 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388281 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388428 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388324 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388428 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388354 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388428 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl65z\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388592 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388504 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388646 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.388617 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:43:59.388646 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.388632 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf547c6d8-jlll2: secret "image-registry-tls" not found Jun 02 16:43:59.388735 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.388688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls podName:54b0b0de-8b5e-4495-a3fa-35892b94722a nodeName:}" failed. No retries permitted until 2026-06-02 16:43:59.888663048 +0000 UTC m=+160.001216889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls") pod "image-registry-6bf547c6d8-jlll2" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a") : secret "image-registry-tls" not found Jun 02 16:43:59.388856 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388826 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388919 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388872 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.388919 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.388897 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.389078 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.389005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.389358 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.389339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.389449 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.389343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.391320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.391298 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.391452 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.391352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.394777 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.394757 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" Jun 02 16:43:59.401901 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.401881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl65z\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.403241 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.403220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.520944 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.520912 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg"] Jun 02 16:43:59.524218 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:43:59.524193 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d66c7d_2e7e_465c_87e9_a4f441f6b389.slice/crio-533fe8844100ef27992ab9446462df9ed0fe683c85f80425d6f8ef122c2c61c7 WatchSource:0}: Error finding container 533fe8844100ef27992ab9446462df9ed0fe683c85f80425d6f8ef122c2c61c7: Status 404 returned error can't find the container with id 533fe8844100ef27992ab9446462df9ed0fe683c85f80425d6f8ef122c2c61c7 Jun 02 16:43:59.692507 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.692423 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:43:59.692658 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.692592 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:43:59.692695 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.692671 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:44:00.692653644 +0000 UTC m=+160.805207490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:43:59.743589 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.743552 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh"] Jun 02 16:43:59.744494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.744460 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8lvd5"] Jun 02 16:43:59.747594 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:43:59.747570 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e22f70a_683a_4661_9351_beb92358b034.slice/crio-f983f1aab18e90e3467b032625d32d81416aecefd8298b75fa8e73bfba0a9ef2 WatchSource:0}: Error finding container f983f1aab18e90e3467b032625d32d81416aecefd8298b75fa8e73bfba0a9ef2: Status 404 returned error can't find the container with id f983f1aab18e90e3467b032625d32d81416aecefd8298b75fa8e73bfba0a9ef2 Jun 02 16:43:59.748158 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:43:59.748134 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd43e3c_ab2e_4d18_bb21_cb6f312ca3cb.slice/crio-9cb91748e1d2b1713493019a77e8998e4ed001cb1f47f12da7a63dc5918e8dfc WatchSource:0}: Error finding container 9cb91748e1d2b1713493019a77e8998e4ed001cb1f47f12da7a63dc5918e8dfc: Status 404 returned error can't find the container with id 9cb91748e1d2b1713493019a77e8998e4ed001cb1f47f12da7a63dc5918e8dfc Jun 02 16:43:59.793871 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.793836 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:43:59.794049 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.793988 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 16:43:59.794089 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.794056 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls podName:2f91ec6a-e48c-4374-8456-e2548bde1905 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:00.794037114 +0000 UTC m=+160.906590959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-lbxcr" (UID: "2f91ec6a-e48c-4374-8456-e2548bde1905") : secret "samples-operator-tls" not found Jun 02 16:43:59.894364 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:43:59.894331 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:43:59.894537 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.894496 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:43:59.894537 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.894513 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf547c6d8-jlll2: secret "image-registry-tls" not found Jun 02 16:43:59.894601 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:43:59.894565 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls podName:54b0b0de-8b5e-4495-a3fa-35892b94722a nodeName:}" failed. No retries permitted until 2026-06-02 16:44:00.894550114 +0000 UTC m=+161.007103959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls") pod "image-registry-6bf547c6d8-jlll2" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a") : secret "image-registry-tls" not found Jun 02 16:44:00.035523 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.035484 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" event={"ID":"7e22f70a-683a-4661-9351-beb92358b034","Type":"ContainerStarted","Data":"f983f1aab18e90e3467b032625d32d81416aecefd8298b75fa8e73bfba0a9ef2"} Jun 02 16:44:00.036414 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.036386 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" event={"ID":"81d66c7d-2e7e-465c-87e9-a4f441f6b389","Type":"ContainerStarted","Data":"533fe8844100ef27992ab9446462df9ed0fe683c85f80425d6f8ef122c2c61c7"} Jun 02 16:44:00.037195 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.037176 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" event={"ID":"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb","Type":"ContainerStarted","Data":"9cb91748e1d2b1713493019a77e8998e4ed001cb1f47f12da7a63dc5918e8dfc"} Jun 02 16:44:00.700118 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.700067 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:00.700417 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.700242 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:00.700417 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.700325 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.700303258 +0000 UTC m=+162.812857113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:00.800697 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.800654 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:00.800901 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.800837 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 16:44:00.800965 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.800923 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls podName:2f91ec6a-e48c-4374-8456-e2548bde1905 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.800897084 +0000 UTC m=+162.913450942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-lbxcr" (UID: "2f91ec6a-e48c-4374-8456-e2548bde1905") : secret "samples-operator-tls" not found Jun 02 16:44:00.901570 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:00.901532 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:00.901783 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.901673 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:44:00.901783 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.901697 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf547c6d8-jlll2: secret "image-registry-tls" not found Jun 02 16:44:00.901783 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:00.901783 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls podName:54b0b0de-8b5e-4495-a3fa-35892b94722a nodeName:}" failed. No retries permitted until 2026-06-02 16:44:02.901762097 +0000 UTC m=+163.014315951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls") pod "image-registry-6bf547c6d8-jlll2" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a") : secret "image-registry-tls" not found Jun 02 16:44:02.114272 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:02.111814 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:44:02.114272 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.112032 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:44:02.114272 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.112105 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls podName:a2e4acac-b598-45f8-b0a8-24363746f93c nodeName:}" failed. No retries permitted until 2026-06-02 16:46:04.112085968 +0000 UTC m=+284.224639829 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls") pod "dns-default-6xg92" (UID: "a2e4acac-b598-45f8-b0a8-24363746f93c") : secret "dns-default-metrics-tls" not found Jun 02 16:44:02.213194 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:02.213150 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:44:02.213357 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.213316 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:44:02.213397 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.213375 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert podName:7901ac90-e2b8-473b-90bc-d15afdaf039e nodeName:}" failed. No retries permitted until 2026-06-02 16:46:04.213359724 +0000 UTC m=+284.325913569 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert") pod "ingress-canary-bktm2" (UID: "7901ac90-e2b8-473b-90bc-d15afdaf039e") : secret "canary-serving-cert" not found Jun 02 16:44:02.717611 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:02.717572 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:02.717792 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.717716 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:02.717839 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.717798 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:44:06.717784054 +0000 UTC m=+166.830337899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:02.818557 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:02.818534 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:02.818654 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.818644 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 16:44:02.818703 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.818695 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls podName:2f91ec6a-e48c-4374-8456-e2548bde1905 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:06.818681203 +0000 UTC m=+166.931235044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-lbxcr" (UID: "2f91ec6a-e48c-4374-8456-e2548bde1905") : secret "samples-operator-tls" not found Jun 02 16:44:02.919577 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:02.919534 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:02.919734 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.919690 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:44:02.919734 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.919710 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf547c6d8-jlll2: secret "image-registry-tls" not found Jun 02 16:44:02.919829 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:02.919781 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls podName:54b0b0de-8b5e-4495-a3fa-35892b94722a nodeName:}" failed. No retries permitted until 2026-06-02 16:44:06.919763844 +0000 UTC m=+167.032317689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls") pod "image-registry-6bf547c6d8-jlll2" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a") : secret "image-registry-tls" not found Jun 02 16:44:03.045029 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:03.044906 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" event={"ID":"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb","Type":"ContainerStarted","Data":"48d6aada1b709d3257b415fd7589a3b40d277cd55d3a10c5196fc9420f8e63da"} Jun 02 16:44:03.046342 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:03.046306 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" event={"ID":"7e22f70a-683a-4661-9351-beb92358b034","Type":"ContainerStarted","Data":"970a916d376b37500542bcf4c376553fa9d70d4fc440721987d9c57e22aa6ed2"} Jun 02 16:44:03.047675 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:03.047652 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" event={"ID":"81d66c7d-2e7e-465c-87e9-a4f441f6b389","Type":"ContainerStarted","Data":"8f975e391946c27234d255acd09c654c9b6488837422abc23ca30d74cfe9bcac"} Jun 02 16:44:03.078362 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:03.078104 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" podStartSLOduration=1.048324836 podStartE2EDuration="4.078089138s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="2026-06-02 16:43:59.750007745 +0000 UTC m=+159.862561587" lastFinishedPulling="2026-06-02 16:44:02.779772034 +0000 UTC m=+162.892325889" observedRunningTime="2026-06-02 16:44:03.062728732 +0000 UTC m=+163.175282597" watchObservedRunningTime="2026-06-02 16:44:03.078089138 +0000 UTC m=+163.190643001" Jun 02 16:44:03.078673 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:03.078646 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" podStartSLOduration=0.821422441 podStartE2EDuration="4.078636827s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="2026-06-02 16:43:59.525922872 +0000 UTC m=+159.638476717" lastFinishedPulling="2026-06-02 16:44:02.783137257 +0000 UTC m=+162.895691103" observedRunningTime="2026-06-02 16:44:03.077966254 +0000 UTC m=+163.190520118" watchObservedRunningTime="2026-06-02 16:44:03.078636827 +0000 UTC m=+163.191190689" Jun 02 16:44:05.303008 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.302958 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" podStartSLOduration=3.267830534 podStartE2EDuration="6.302941143s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="2026-06-02 16:43:59.749823434 +0000 UTC m=+159.862377289" lastFinishedPulling="2026-06-02 16:44:02.784934048 +0000 UTC m=+162.897487898" observedRunningTime="2026-06-02 16:44:03.095316851 +0000 UTC m=+163.207870715" watchObservedRunningTime="2026-06-02 16:44:05.302941143 +0000 UTC m=+165.415495049" Jun 02 16:44:05.303535 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.303323 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n"] Jun 02 16:44:05.309956 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.309933 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" Jun 02 16:44:05.313793 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.313769 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 16:44:05.313933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.313825 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 16:44:05.313933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.313828 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b672x\"" Jun 02 16:44:05.314861 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.314838 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n"] Jun 02 16:44:05.440554 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.440499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhqp\" (UniqueName: \"kubernetes.io/projected/b0e0701d-13cd-4fed-ade1-63c48d42bc00-kube-api-access-2zhqp\") pod \"migrator-96c6f749-69t5n\" (UID: \"b0e0701d-13cd-4fed-ade1-63c48d42bc00\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" Jun 02 16:44:05.540897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.540863 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhqp\" (UniqueName: \"kubernetes.io/projected/b0e0701d-13cd-4fed-ade1-63c48d42bc00-kube-api-access-2zhqp\") pod \"migrator-96c6f749-69t5n\" (UID: \"b0e0701d-13cd-4fed-ade1-63c48d42bc00\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" Jun 02 16:44:05.549836 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.549806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhqp\" (UniqueName: \"kubernetes.io/projected/b0e0701d-13cd-4fed-ade1-63c48d42bc00-kube-api-access-2zhqp\") pod \"migrator-96c6f749-69t5n\" (UID: \"b0e0701d-13cd-4fed-ade1-63c48d42bc00\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" Jun 02 16:44:05.619589 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.619515 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" Jun 02 16:44:05.744318 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:05.744289 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n"] Jun 02 16:44:05.746998 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:05.746975 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e0701d_13cd_4fed_ade1_63c48d42bc00.slice/crio-f40af6a709f495d97ab86fd3fea580a1f54850f6c61d56764e4c4132eb28d65d WatchSource:0}: Error finding container f40af6a709f495d97ab86fd3fea580a1f54850f6c61d56764e4c4132eb28d65d: Status 404 returned error can't find the container with id f40af6a709f495d97ab86fd3fea580a1f54850f6c61d56764e4c4132eb28d65d Jun 02 16:44:06.057315 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:06.057279 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" event={"ID":"b0e0701d-13cd-4fed-ade1-63c48d42bc00","Type":"ContainerStarted","Data":"f40af6a709f495d97ab86fd3fea580a1f54850f6c61d56764e4c4132eb28d65d"} Jun 02 16:44:06.083687 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:06.083662 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5ml9_8efbf40f-998c-4cf6-bc40-6708f9ee9823/dns-node-resolver/0.log" Jun 02 16:44:06.749202 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:06.749155 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:06.749624 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.749300 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:06.749624 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.749367 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:44:14.749352358 +0000 UTC m=+174.861906204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:06.849596 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:06.849557 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:06.849816 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.849733 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 16:44:06.849889 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.849828 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls podName:2f91ec6a-e48c-4374-8456-e2548bde1905 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:14.849806743 +0000 UTC m=+174.962360598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-lbxcr" (UID: "2f91ec6a-e48c-4374-8456-e2548bde1905") : secret "samples-operator-tls" not found Jun 02 16:44:06.950981 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:06.950949 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:06.951124 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.951106 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 16:44:06.951170 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.951127 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf547c6d8-jlll2: secret "image-registry-tls" not found Jun 02 16:44:06.951203 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:06.951178 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls podName:54b0b0de-8b5e-4495-a3fa-35892b94722a nodeName:}" failed. No retries permitted until 2026-06-02 16:44:14.951163195 +0000 UTC m=+175.063717041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls") pod "image-registry-6bf547c6d8-jlll2" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a") : secret "image-registry-tls" not found Jun 02 16:44:07.290499 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:07.290479 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wv4p5_4aeaa789-664b-43a5-bd66-6de2a4c12eeb/node-ca/0.log" Jun 02 16:44:08.063574 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:08.063538 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" event={"ID":"b0e0701d-13cd-4fed-ade1-63c48d42bc00","Type":"ContainerStarted","Data":"1a2033350fd96e928deb21f985b73582edd8ea35baa3d19185bc68506f304ab8"} Jun 02 16:44:08.063574 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:08.063577 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" event={"ID":"b0e0701d-13cd-4fed-ade1-63c48d42bc00","Type":"ContainerStarted","Data":"45fde1489aeaa3561ff2402b63b012108a37142c3a75371367fc77fed73f45c5"} Jun 02 16:44:08.081350 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:08.081303 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-69t5n" podStartSLOduration=1.604324351 podStartE2EDuration="3.081291051s" podCreationTimestamp="2026-06-02 16:44:05 +0000 UTC" firstStartedPulling="2026-06-02 16:44:05.749219005 +0000 UTC m=+165.861772846" lastFinishedPulling="2026-06-02 16:44:07.226185702 +0000 UTC m=+167.338739546" observedRunningTime="2026-06-02 16:44:08.080786465 +0000 UTC m=+168.193340328" watchObservedRunningTime="2026-06-02 16:44:08.081291051 +0000 UTC m=+168.193844913" Jun 02 16:44:08.492041 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:08.492007 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:44:09.492229 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:09.492196 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:44:14.807061 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:14.807023 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:14.807465 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:14.807170 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:14.807465 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:14.807242 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls podName:cdd37660-0c52-417b-9a94-deb92a3d9ece nodeName:}" failed. No retries permitted until 2026-06-02 16:44:30.807227326 +0000 UTC m=+190.919781167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9xhxj" (UID: "cdd37660-0c52-417b-9a94-deb92a3d9ece") : secret "cluster-monitoring-operator-tls" not found Jun 02 16:44:14.908008 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:14.907977 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:14.910418 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:14.910391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f91ec6a-e48c-4374-8456-e2548bde1905-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-lbxcr\" (UID: \"2f91ec6a-e48c-4374-8456-e2548bde1905\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:14.989814 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:14.989783 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" Jun 02 16:44:15.008852 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:15.008821 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:15.011187 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:15.011153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"image-registry-6bf547c6d8-jlll2\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:15.079099 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:15.079063 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:15.113407 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:15.113373 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr"] Jun 02 16:44:15.211927 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:15.211896 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:44:15.214958 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:15.214935 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b0b0de_8b5e_4495_a3fa_35892b94722a.slice/crio-11f9006ee5dd2a7c10562d21ff94147c768e673059516606390ec156dae4df2e WatchSource:0}: Error finding container 11f9006ee5dd2a7c10562d21ff94147c768e673059516606390ec156dae4df2e: Status 404 returned error can't find the container with id 11f9006ee5dd2a7c10562d21ff94147c768e673059516606390ec156dae4df2e Jun 02 16:44:16.085093 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:16.085061 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" event={"ID":"54b0b0de-8b5e-4495-a3fa-35892b94722a","Type":"ContainerStarted","Data":"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe"} Jun 02 16:44:16.085093 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:16.085097 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" event={"ID":"54b0b0de-8b5e-4495-a3fa-35892b94722a","Type":"ContainerStarted","Data":"11f9006ee5dd2a7c10562d21ff94147c768e673059516606390ec156dae4df2e"} Jun 02 16:44:16.085544 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:16.085125 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:16.086094 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:16.086068 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" event={"ID":"2f91ec6a-e48c-4374-8456-e2548bde1905","Type":"ContainerStarted","Data":"e89864eb690f2635fb6d7b770e388109dfd117b8681448361452fb3af9b5b708"} Jun 02 16:44:16.105992 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:16.105945 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" podStartSLOduration=17.105929013 podStartE2EDuration="17.105929013s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:44:16.105089796 +0000 UTC m=+176.217643663" watchObservedRunningTime="2026-06-02 16:44:16.105929013 +0000 UTC m=+176.218482880" Jun 02 16:44:17.090375 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:17.090338 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" event={"ID":"2f91ec6a-e48c-4374-8456-e2548bde1905","Type":"ContainerStarted","Data":"364ebe630fac9f8e7ce42eb110ca9415e7cd68ea3f512824e415bd028f4bb921"} Jun 02 16:44:17.090790 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:17.090385 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" event={"ID":"2f91ec6a-e48c-4374-8456-e2548bde1905","Type":"ContainerStarted","Data":"0dc99558432b511a242b2e6469adf4dbcb23ff22c3f045a6c490419721f4b67b"} Jun 02 16:44:17.110149 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:17.110097 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-lbxcr" podStartSLOduration=16.31677319 podStartE2EDuration="18.110078825s" podCreationTimestamp="2026-06-02 16:43:59 +0000 UTC" firstStartedPulling="2026-06-02 16:44:15.163328154 +0000 UTC m=+175.275882004" lastFinishedPulling="2026-06-02 16:44:16.956633798 +0000 UTC m=+177.069187639" observedRunningTime="2026-06-02 16:44:17.109544593 +0000 UTC m=+177.222098653" watchObservedRunningTime="2026-06-02 16:44:17.110078825 +0000 UTC m=+177.222632688" Jun 02 16:44:27.237567 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.237520 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v48xh"] Jun 02 16:44:27.243670 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.243653 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.247178 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.247152 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 16:44:27.247178 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.247161 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 16:44:27.247323 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.247207 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8m8cx\"" Jun 02 16:44:27.254289 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.254271 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:44:27.263556 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.263529 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v48xh"] Jun 02 16:44:27.294671 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.294639 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-758ddfcfc5-dsj8j"] Jun 02 16:44:27.298559 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.298543 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.306425 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.306403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e77ef812-caa3-4bec-a6a5-559ae23c2411-crio-socket\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.306555 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.306432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e77ef812-caa3-4bec-a6a5-559ae23c2411-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.306555 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.306454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.306555 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.306510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvrl6\" (UniqueName: \"kubernetes.io/projected/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-api-access-kvrl6\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.306650 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.306578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e77ef812-caa3-4bec-a6a5-559ae23c2411-data-volume\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.311655 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.311625 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-758ddfcfc5-dsj8j"] Jun 02 16:44:27.407700 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407670 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e77ef812-caa3-4bec-a6a5-559ae23c2411-crio-socket\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.407700 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407702 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e77ef812-caa3-4bec-a6a5-559ae23c2411-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.407908 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407726 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.407908 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-certificates\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.407908 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glx7c\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-kube-api-access-glx7c\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.407908 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e77ef812-caa3-4bec-a6a5-559ae23c2411-crio-socket\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.408074 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-tls\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408074 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.407978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-trusted-ca\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408074 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408009 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvrl6\" (UniqueName: \"kubernetes.io/projected/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-api-access-kvrl6\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.408074 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408034 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e77ef812-caa3-4bec-a6a5-559ae23c2411-data-volume\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.408241 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-installation-pull-secrets\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408241 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-bound-sa-token\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408241 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-image-registry-private-configuration\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408352 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e22a96c1-3332-40c9-b5e5-54e58784c10d-ca-trust-extracted\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.408352 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e77ef812-caa3-4bec-a6a5-559ae23c2411-data-volume\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.408431 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.408346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.410166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.410140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e77ef812-caa3-4bec-a6a5-559ae23c2411-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.420285 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.420264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvrl6\" (UniqueName: \"kubernetes.io/projected/e77ef812-caa3-4bec-a6a5-559ae23c2411-kube-api-access-kvrl6\") pod \"insights-runtime-extractor-v48xh\" (UID: \"e77ef812-caa3-4bec-a6a5-559ae23c2411\") " pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.509465 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509380 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-installation-pull-secrets\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509465 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509428 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-bound-sa-token\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509663 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509551 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-image-registry-private-configuration\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509663 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509598 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e22a96c1-3332-40c9-b5e5-54e58784c10d-ca-trust-extracted\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509775 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-certificates\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509775 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509703 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glx7c\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-kube-api-access-glx7c\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509878 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509776 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-tls\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.509878 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.509813 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-trusted-ca\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.510041 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.510017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e22a96c1-3332-40c9-b5e5-54e58784c10d-ca-trust-extracted\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.510404 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.510383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-certificates\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.511087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.511066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e22a96c1-3332-40c9-b5e5-54e58784c10d-trusted-ca\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.511960 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.511937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-image-registry-private-configuration\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.512102 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.512084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e22a96c1-3332-40c9-b5e5-54e58784c10d-installation-pull-secrets\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.512353 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.512331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-registry-tls\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.518977 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.518943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glx7c\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-kube-api-access-glx7c\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.519250 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.519231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22a96c1-3332-40c9-b5e5-54e58784c10d-bound-sa-token\") pod \"image-registry-758ddfcfc5-dsj8j\" (UID: \"e22a96c1-3332-40c9-b5e5-54e58784c10d\") " pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.551901 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.551879 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v48xh" Jun 02 16:44:27.606550 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.606524 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:27.687922 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.687894 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v48xh"] Jun 02 16:44:27.691324 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:27.691291 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77ef812_caa3_4bec_a6a5_559ae23c2411.slice/crio-60c6f52d13a8d15d66dc933eccc0daa2eed9538184792650e48fff39560ac135 WatchSource:0}: Error finding container 60c6f52d13a8d15d66dc933eccc0daa2eed9538184792650e48fff39560ac135: Status 404 returned error can't find the container with id 60c6f52d13a8d15d66dc933eccc0daa2eed9538184792650e48fff39560ac135 Jun 02 16:44:27.755669 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:27.755642 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-758ddfcfc5-dsj8j"] Jun 02 16:44:27.758612 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:27.758590 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22a96c1_3332_40c9_b5e5_54e58784c10d.slice/crio-e6a643f28a8c9bcd64be87cf94845f4123aa55c6a6f7b07123010f60eb64f041 WatchSource:0}: Error finding container e6a643f28a8c9bcd64be87cf94845f4123aa55c6a6f7b07123010f60eb64f041: Status 404 returned error can't find the container with id e6a643f28a8c9bcd64be87cf94845f4123aa55c6a6f7b07123010f60eb64f041 Jun 02 16:44:28.119173 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.119083 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v48xh" event={"ID":"e77ef812-caa3-4bec-a6a5-559ae23c2411","Type":"ContainerStarted","Data":"70f2fdd90358f384ba4c376fe74dd1baf685c6b621451d13f771fbe77b808274"} Jun 02 16:44:28.119173 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.119125 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v48xh" event={"ID":"e77ef812-caa3-4bec-a6a5-559ae23c2411","Type":"ContainerStarted","Data":"60c6f52d13a8d15d66dc933eccc0daa2eed9538184792650e48fff39560ac135"} Jun 02 16:44:28.120374 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.120352 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerStarted","Data":"b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8"} Jun 02 16:44:28.120374 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.120375 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerStarted","Data":"e6a643f28a8c9bcd64be87cf94845f4123aa55c6a6f7b07123010f60eb64f041"} Jun 02 16:44:28.120553 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.120516 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:44:28.141074 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:28.141016 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podStartSLOduration=1.140998727 podStartE2EDuration="1.140998727s" podCreationTimestamp="2026-06-02 16:44:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:44:28.139685411 +0000 UTC m=+188.252239275" watchObservedRunningTime="2026-06-02 16:44:28.140998727 +0000 UTC m=+188.253552591" Jun 02 16:44:29.124664 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:29.124622 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v48xh" event={"ID":"e77ef812-caa3-4bec-a6a5-559ae23c2411","Type":"ContainerStarted","Data":"7c30021a36221d76c39cb51e498dc34c0fe33cf0683f9fac78a0743ba418450e"} Jun 02 16:44:30.839724 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:30.839672 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:30.842089 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:30.842069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdd37660-0c52-417b-9a94-deb92a3d9ece-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9xhxj\" (UID: \"cdd37660-0c52-417b-9a94-deb92a3d9ece\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:31.074680 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:31.074647 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v89sc\"" Jun 02 16:44:31.082354 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:31.082329 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" Jun 02 16:44:31.134626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:31.134593 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v48xh" event={"ID":"e77ef812-caa3-4bec-a6a5-559ae23c2411","Type":"ContainerStarted","Data":"00e1e2a7a45a7e7e86907180aae6c0ce4c72306ed25bd2e1f1d7f167b3e9559c"} Jun 02 16:44:31.152915 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:31.152865 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v48xh" podStartSLOduration=1.7361962260000001 podStartE2EDuration="4.15284689s" podCreationTimestamp="2026-06-02 16:44:27 +0000 UTC" firstStartedPulling="2026-06-02 16:44:27.760643856 +0000 UTC m=+187.873197697" lastFinishedPulling="2026-06-02 16:44:30.17729452 +0000 UTC m=+190.289848361" observedRunningTime="2026-06-02 16:44:31.152058673 +0000 UTC m=+191.264612537" watchObservedRunningTime="2026-06-02 16:44:31.15284689 +0000 UTC m=+191.265400753" Jun 02 16:44:31.207301 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:31.207272 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj"] Jun 02 16:44:31.210319 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:31.210290 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd37660_0c52_417b_9a94_deb92a3d9ece.slice/crio-4373a6b854e9f20b40288b4816af9d2ee4d86aef4d87e125f899ebeb0440b701 WatchSource:0}: Error finding container 4373a6b854e9f20b40288b4816af9d2ee4d86aef4d87e125f899ebeb0440b701: Status 404 returned error can't find the container with id 4373a6b854e9f20b40288b4816af9d2ee4d86aef4d87e125f899ebeb0440b701 Jun 02 16:44:32.137582 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:32.137547 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" event={"ID":"cdd37660-0c52-417b-9a94-deb92a3d9ece","Type":"ContainerStarted","Data":"4373a6b854e9f20b40288b4816af9d2ee4d86aef4d87e125f899ebeb0440b701"} Jun 02 16:44:34.143943 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:34.143908 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" event={"ID":"cdd37660-0c52-417b-9a94-deb92a3d9ece","Type":"ContainerStarted","Data":"bc34dc6755364fd22d3a5ab41801e6b46ce946dfc51a0fcbe71e43b5c1926943"} Jun 02 16:44:34.163886 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:34.163839 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9xhxj" podStartSLOduration=33.79441387 podStartE2EDuration="36.163825415s" podCreationTimestamp="2026-06-02 16:43:58 +0000 UTC" firstStartedPulling="2026-06-02 16:44:31.212654257 +0000 UTC m=+191.325208098" lastFinishedPulling="2026-06-02 16:44:33.582065801 +0000 UTC m=+193.694619643" observedRunningTime="2026-06-02 16:44:34.163119663 +0000 UTC m=+194.275673547" watchObservedRunningTime="2026-06-02 16:44:34.163825415 +0000 UTC m=+194.276379279" Jun 02 16:44:37.259037 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:37.258998 2565 patch_prober.go:28] interesting pod/image-registry-6bf547c6d8-jlll2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:37.259401 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:37.259053 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:44:38.886578 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:38.886541 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" podUID="aefcd37c-8c89-4f1b-bdf0-4682c65f7b98" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.7:8000/readyz\": dial tcp 10.134.0.7:8000: connect: connection refused" Jun 02 16:44:39.156774 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:39.156675 2565 generic.go:358] "Generic (PLEG): container finished" podID="aefcd37c-8c89-4f1b-bdf0-4682c65f7b98" containerID="a1b64afc6a5fe35af4942b5e7d4b3df7c74da0847dcd4199d25447b9e80c9a03" exitCode=1 Jun 02 16:44:39.156774 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:39.156722 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" event={"ID":"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98","Type":"ContainerDied","Data":"a1b64afc6a5fe35af4942b5e7d4b3df7c74da0847dcd4199d25447b9e80c9a03"} Jun 02 16:44:39.157063 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:39.157049 2565 scope.go:117] "RemoveContainer" containerID="a1b64afc6a5fe35af4942b5e7d4b3df7c74da0847dcd4199d25447b9e80c9a03" Jun 02 16:44:40.160594 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:40.160541 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" event={"ID":"aefcd37c-8c89-4f1b-bdf0-4682c65f7b98","Type":"ContainerStarted","Data":"21cb8000d7245f477ac3f508bbea2f9679508aa429d53b5e2396e2a643d9e1b7"} Jun 02 16:44:40.161051 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:40.160828 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:44:40.161462 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:40.161445 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-87cb8d4dd-wfp85" Jun 02 16:44:41.536894 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.536861 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pj7nk"] Jun 02 16:44:41.540237 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.540218 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.542654 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.542636 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 16:44:41.542799 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.542779 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 16:44:41.542853 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.542845 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 16:44:41.542886 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.542864 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 16:44:41.543976 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.543959 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sx4bp\"" Jun 02 16:44:41.631185 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2278s\" (UniqueName: \"kubernetes.io/projected/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-kube-api-access-2278s\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-sys\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-textfile\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631527 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-tls\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631527 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-root\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631527 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-metrics-client-ca\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.631527 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.631448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-wtmp\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.732785 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.732734 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-metrics-client-ca\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733001 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.732791 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-wtmp\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733001 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.732814 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733001 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.732835 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733001 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.732852 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2278s\" (UniqueName: \"kubernetes.io/projected/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-kube-api-access-2278s\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-wtmp\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733026 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-sys\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733103 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-textfile\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733132 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-tls\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733172 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-sys\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733215 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733200 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-root\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-root\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-metrics-client-ca\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733494 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-textfile\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.733607 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.733495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.735266 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.735246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.735507 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.735484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-node-exporter-tls\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.741943 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.741919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2278s\" (UniqueName: \"kubernetes.io/projected/f74e94d5-2b76-4bed-bb5a-ce819b1b01ca-kube-api-access-2278s\") pod \"node-exporter-pj7nk\" (UID: \"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca\") " pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.849321 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:41.849238 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj7nk" Jun 02 16:44:41.857243 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:41.857214 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74e94d5_2b76_4bed_bb5a_ce819b1b01ca.slice/crio-6bc380d7f8e2916c8db01acacfbd3f5906ad9b202a83156d30ae5e89e6bae8f1 WatchSource:0}: Error finding container 6bc380d7f8e2916c8db01acacfbd3f5906ad9b202a83156d30ae5e89e6bae8f1: Status 404 returned error can't find the container with id 6bc380d7f8e2916c8db01acacfbd3f5906ad9b202a83156d30ae5e89e6bae8f1 Jun 02 16:44:42.166468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:42.166380 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj7nk" event={"ID":"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca","Type":"ContainerStarted","Data":"6bc380d7f8e2916c8db01acacfbd3f5906ad9b202a83156d30ae5e89e6bae8f1"} Jun 02 16:44:43.170232 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.170148 2565 generic.go:358] "Generic (PLEG): container finished" podID="f74e94d5-2b76-4bed-bb5a-ce819b1b01ca" containerID="5e5b04b791062b3a2536ce15e983718cd5f117cc6e92de9150501ccd9a6acd85" exitCode=0 Jun 02 16:44:43.170573 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.170230 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj7nk" event={"ID":"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca","Type":"ContainerDied","Data":"5e5b04b791062b3a2536ce15e983718cd5f117cc6e92de9150501ccd9a6acd85"} Jun 02 16:44:43.490730 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.490697 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-544d55f7c-8mzbb"] Jun 02 16:44:43.494251 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.494235 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.497016 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.496994 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5ztx8\"" Jun 02 16:44:43.497016 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497004 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 16:44:43.497189 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497002 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 16:44:43.497189 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497108 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e5g9jrv230rr2\"" Jun 02 16:44:43.497189 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497120 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 16:44:43.497189 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497108 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 16:44:43.497408 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.497396 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 16:44:43.507576 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.507547 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-544d55f7c-8mzbb"] Jun 02 16:44:43.651000 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.650966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651156 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-metrics-client-ca\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651156 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwl4l\" (UniqueName: \"kubernetes.io/projected/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-kube-api-access-zwl4l\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651156 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-grpc-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651156 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.651320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.651243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752380 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwl4l\" (UniqueName: \"kubernetes.io/projected/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-kube-api-access-zwl4l\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752380 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752352 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-grpc-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752380 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752372 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752410 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752432 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752451 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752474 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.752626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.752517 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-metrics-client-ca\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.753480 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.753452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-metrics-client-ca\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755152 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755626 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-grpc-tls\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755902 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755944 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.755994 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.755978 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.762830 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.762809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwl4l\" (UniqueName: \"kubernetes.io/projected/377e12c2-3b74-4ec7-a64f-d8ea13c8627d-kube-api-access-zwl4l\") pod \"thanos-querier-544d55f7c-8mzbb\" (UID: \"377e12c2-3b74-4ec7-a64f-d8ea13c8627d\") " pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.802814 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.802796 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:43.928566 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:43.928525 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-544d55f7c-8mzbb"] Jun 02 16:44:43.931741 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:43.931714 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377e12c2_3b74_4ec7_a64f_d8ea13c8627d.slice/crio-452af7248d4247c90bbd660e147783aaecd600388fecf525dce4b3afffa7ac70 WatchSource:0}: Error finding container 452af7248d4247c90bbd660e147783aaecd600388fecf525dce4b3afffa7ac70: Status 404 returned error can't find the container with id 452af7248d4247c90bbd660e147783aaecd600388fecf525dce4b3afffa7ac70 Jun 02 16:44:44.178389 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:44.178298 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj7nk" event={"ID":"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca","Type":"ContainerStarted","Data":"91ebbb7d255beafdbf3cf975df58d395ba59ec4335599c2c7af16bf83d8f256b"} Jun 02 16:44:44.178389 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:44.178335 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj7nk" event={"ID":"f74e94d5-2b76-4bed-bb5a-ce819b1b01ca","Type":"ContainerStarted","Data":"c4cd4a1d0a2b018996771d1f992e65fce1ec2006454b6a3a53531d87118d33f3"} Jun 02 16:44:44.179340 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:44.179318 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"452af7248d4247c90bbd660e147783aaecd600388fecf525dce4b3afffa7ac70"} Jun 02 16:44:44.197655 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:44.197609 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pj7nk" podStartSLOduration=2.298348274 podStartE2EDuration="3.197596098s" podCreationTimestamp="2026-06-02 16:44:41 +0000 UTC" firstStartedPulling="2026-06-02 16:44:41.859009148 +0000 UTC m=+201.971562993" lastFinishedPulling="2026-06-02 16:44:42.758256972 +0000 UTC m=+202.870810817" observedRunningTime="2026-06-02 16:44:44.196471261 +0000 UTC m=+204.309025125" watchObservedRunningTime="2026-06-02 16:44:44.197596098 +0000 UTC m=+204.310149964" Jun 02 16:44:46.186893 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.186857 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"3b267876591eb095fe1a1223f29c9bbf987d4ce01a0e13559d1d0d2bcf5ef689"} Jun 02 16:44:46.275100 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.275074 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42"] Jun 02 16:44:46.279207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.279188 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:46.281646 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.281624 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 16:44:46.281912 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.281726 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-2wlgk\"" Jun 02 16:44:46.287988 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.287960 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42"] Jun 02 16:44:46.377741 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.377658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-bdh42\" (UID: \"2492eefd-d68c-47ca-bd66-36125942988f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:46.479163 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.479117 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-bdh42\" (UID: \"2492eefd-d68c-47ca-bd66-36125942988f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:46.479340 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:46.479270 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 16:44:46.479340 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:46.479338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert podName:2492eefd-d68c-47ca-bd66-36125942988f nodeName:}" failed. No retries permitted until 2026-06-02 16:44:46.979319211 +0000 UTC m=+207.091873053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-bdh42" (UID: "2492eefd-d68c-47ca-bd66-36125942988f") : secret "monitoring-plugin-cert" not found Jun 02 16:44:46.984136 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.984098 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-bdh42\" (UID: \"2492eefd-d68c-47ca-bd66-36125942988f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:46.986980 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:46.986949 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2492eefd-d68c-47ca-bd66-36125942988f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-bdh42\" (UID: \"2492eefd-d68c-47ca-bd66-36125942988f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:47.187642 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.187614 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:47.190631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.190606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"fb6956f2f319652f45959c4b2b2f0c6d8feb315472ff33c97b81c2ae3c8042fd"} Jun 02 16:44:47.190733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.190640 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"3aa440a142d241d102cb38c5475b8b3f6d552939aff256c4dc2a371b87491576"} Jun 02 16:44:47.263065 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.263023 2565 patch_prober.go:28] interesting pod/image-registry-6bf547c6d8-jlll2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:47.263210 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.263083 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:44:47.339921 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.339896 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42"] Jun 02 16:44:47.343181 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:44:47.343156 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2492eefd_d68c_47ca_bd66_36125942988f.slice/crio-c57d76cc5b7fd6f5a0ae84f0bcabcfa071a289fe5bc6f6a9e23826ed7b3ad063 WatchSource:0}: Error finding container c57d76cc5b7fd6f5a0ae84f0bcabcfa071a289fe5bc6f6a9e23826ed7b3ad063: Status 404 returned error can't find the container with id c57d76cc5b7fd6f5a0ae84f0bcabcfa071a289fe5bc6f6a9e23826ed7b3ad063 Jun 02 16:44:47.610989 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.610917 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:47.610989 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:47.610961 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:44:48.196250 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.196211 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"d0e21bbbaa17f3e0253c9597d5d1d5f21bc23c0dd070d6fee26998e599186530"} Jun 02 16:44:48.196736 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.196257 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"0168b67bec0d7ad46070dca989553396fde1e55018ca628b047db72bfd7f124d"} Jun 02 16:44:48.196736 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.196272 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" event={"ID":"377e12c2-3b74-4ec7-a64f-d8ea13c8627d","Type":"ContainerStarted","Data":"9e4abfcce1e2ee7a4c0246563adf9aaca9b170faa5fa6dd6f3f482b0de2cfc17"} Jun 02 16:44:48.196736 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.196478 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:48.201958 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.201919 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" event={"ID":"2492eefd-d68c-47ca-bd66-36125942988f","Type":"ContainerStarted","Data":"c57d76cc5b7fd6f5a0ae84f0bcabcfa071a289fe5bc6f6a9e23826ed7b3ad063"} Jun 02 16:44:48.259140 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:48.259073 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" podStartSLOduration=1.979224452 podStartE2EDuration="5.259056653s" podCreationTimestamp="2026-06-02 16:44:43 +0000 UTC" firstStartedPulling="2026-06-02 16:44:43.933511955 +0000 UTC m=+204.046065797" lastFinishedPulling="2026-06-02 16:44:47.213344157 +0000 UTC m=+207.325897998" observedRunningTime="2026-06-02 16:44:48.258785554 +0000 UTC m=+208.371339419" watchObservedRunningTime="2026-06-02 16:44:48.259056653 +0000 UTC m=+208.371610517" Jun 02 16:44:49.129056 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.129019 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:49.129187 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.129068 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:44:49.205695 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.205656 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" event={"ID":"2492eefd-d68c-47ca-bd66-36125942988f","Type":"ContainerStarted","Data":"6a48e758c8818e1bc1513c4570958ad1e168be4f37ada5ed80ed72b3dccd7ef6"} Jun 02 16:44:49.206151 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.205707 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:49.210408 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.210388 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" Jun 02 16:44:49.241396 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:49.241348 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-bdh42" podStartSLOduration=1.547692406 podStartE2EDuration="3.24133182s" podCreationTimestamp="2026-06-02 16:44:46 +0000 UTC" firstStartedPulling="2026-06-02 16:44:47.345043324 +0000 UTC m=+207.457597168" lastFinishedPulling="2026-06-02 16:44:49.038682741 +0000 UTC m=+209.151236582" observedRunningTime="2026-06-02 16:44:49.223601446 +0000 UTC m=+209.336155309" watchObservedRunningTime="2026-06-02 16:44:49.24133182 +0000 UTC m=+209.353885682" Jun 02 16:44:52.276004 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.275964 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" containerID="cri-o://2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe" gracePeriod=30 Jun 02 16:44:52.521491 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.521469 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:52.633733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633637 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.633733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633686 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.633733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633721 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633791 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633825 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633859 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633891 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl65z\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634026 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.633938 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token\") pod \"54b0b0de-8b5e-4495-a3fa-35892b94722a\" (UID: \"54b0b0de-8b5e-4495-a3fa-35892b94722a\") " Jun 02 16:44:52.634348 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.634280 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:44:52.634348 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.634300 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:44:52.636477 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.636390 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:44:52.636605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.636504 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z" (OuterVolumeSpecName: "kube-api-access-bl65z") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "kube-api-access-bl65z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:44:52.636605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.636588 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:44:52.636687 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.636676 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:44:52.636799 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.636777 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:44:52.642363 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.642338 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "54b0b0de-8b5e-4495-a3fa-35892b94722a" (UID: "54b0b0de-8b5e-4495-a3fa-35892b94722a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:44:52.735540 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735501 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-tls\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735540 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735532 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-image-registry-private-configuration\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735540 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735543 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl65z\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-kube-api-access-bl65z\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735554 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54b0b0de-8b5e-4495-a3fa-35892b94722a-bound-sa-token\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735564 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54b0b0de-8b5e-4495-a3fa-35892b94722a-ca-trust-extracted\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735573 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54b0b0de-8b5e-4495-a3fa-35892b94722a-installation-pull-secrets\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735582 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-trusted-ca\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:52.735800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:52.735591 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54b0b0de-8b5e-4495-a3fa-35892b94722a-registry-certificates\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:44:53.218266 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.218230 2565 generic.go:358] "Generic (PLEG): container finished" podID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerID="2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe" exitCode=0 Jun 02 16:44:53.218424 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.218293 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" Jun 02 16:44:53.218424 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.218299 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" event={"ID":"54b0b0de-8b5e-4495-a3fa-35892b94722a","Type":"ContainerDied","Data":"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe"} Jun 02 16:44:53.218424 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.218334 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bf547c6d8-jlll2" event={"ID":"54b0b0de-8b5e-4495-a3fa-35892b94722a","Type":"ContainerDied","Data":"11f9006ee5dd2a7c10562d21ff94147c768e673059516606390ec156dae4df2e"} Jun 02 16:44:53.218424 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.218353 2565 scope.go:117] "RemoveContainer" containerID="2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe" Jun 02 16:44:53.226441 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.226421 2565 scope.go:117] "RemoveContainer" containerID="2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe" Jun 02 16:44:53.226713 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:44:53.226693 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe\": container with ID starting with 2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe not found: ID does not exist" containerID="2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe" Jun 02 16:44:53.226777 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.226722 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe"} err="failed to get container status \"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe\": rpc error: code = NotFound desc = could not find container \"2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe\": container with ID starting with 2041093ed9177bc82ae248047176ba269bd6b2856a036ca646f2143921e675fe not found: ID does not exist" Jun 02 16:44:53.240326 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.240301 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:44:53.245522 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:53.245500 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bf547c6d8-jlll2"] Jun 02 16:44:54.212886 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:54.212859 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-544d55f7c-8mzbb" Jun 02 16:44:54.496857 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:54.496785 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" path="/var/lib/kubelet/pods/54b0b0de-8b5e-4495-a3fa-35892b94722a/volumes" Jun 02 16:44:57.611116 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:57.611085 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:57.611524 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:57.611133 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:44:59.128289 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:59.128259 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:44:59.128652 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:44:59.128310 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:01.717184 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.717154 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwqkt"] Jun 02 16:45:01.717596 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.717406 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" Jun 02 16:45:01.717596 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.717417 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" Jun 02 16:45:01.717596 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.717500 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b0b0de-8b5e-4495-a3fa-35892b94722a" containerName="registry" Jun 02 16:45:01.720109 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.720094 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:01.722953 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.722932 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 16:45:01.723170 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.723155 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kfpjf\"" Jun 02 16:45:01.723342 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.723329 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 16:45:01.732233 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.732208 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwqkt"] Jun 02 16:45:01.805238 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.805200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjz6\" (UniqueName: \"kubernetes.io/projected/2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f-kube-api-access-jxjz6\") pod \"downloads-c65b8dc4b-rwqkt\" (UID: \"2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f\") " pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:01.905918 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.905886 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjz6\" (UniqueName: \"kubernetes.io/projected/2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f-kube-api-access-jxjz6\") pod \"downloads-c65b8dc4b-rwqkt\" (UID: \"2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f\") " pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:01.915163 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:01.915134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjz6\" (UniqueName: \"kubernetes.io/projected/2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f-kube-api-access-jxjz6\") pod \"downloads-c65b8dc4b-rwqkt\" (UID: \"2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f\") " pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:02.029340 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:02.029240 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:02.150801 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:02.150778 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwqkt"] Jun 02 16:45:02.153253 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:45:02.153229 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de7d7d8_5cfb_4a49_a0c9_78b73a01ba8f.slice/crio-5fe0bc4f9d0cc24ef3f519722ec27566fa86383fa5278f2bfe226b6f880898ca WatchSource:0}: Error finding container 5fe0bc4f9d0cc24ef3f519722ec27566fa86383fa5278f2bfe226b6f880898ca: Status 404 returned error can't find the container with id 5fe0bc4f9d0cc24ef3f519722ec27566fa86383fa5278f2bfe226b6f880898ca Jun 02 16:45:02.249483 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:02.249447 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rwqkt" event={"ID":"2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f","Type":"ContainerStarted","Data":"5fe0bc4f9d0cc24ef3f519722ec27566fa86383fa5278f2bfe226b6f880898ca"} Jun 02 16:45:07.611328 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.611293 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:07.611938 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.611355 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:07.611938 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.611403 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:45:07.612042 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.612020 2565 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8"} pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" containerMessage="Container registry failed liveness probe, will be restarted" Jun 02 16:45:07.615921 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.615895 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:07.616050 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:07.615954 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:17.617035 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:17.616998 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:17.617458 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:17.617079 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:19.297282 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.297253 2565 generic.go:358] "Generic (PLEG): container finished" podID="7e22f70a-683a-4661-9351-beb92358b034" containerID="970a916d376b37500542bcf4c376553fa9d70d4fc440721987d9c57e22aa6ed2" exitCode=0 Jun 02 16:45:19.297699 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.297333 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" event={"ID":"7e22f70a-683a-4661-9351-beb92358b034","Type":"ContainerDied","Data":"970a916d376b37500542bcf4c376553fa9d70d4fc440721987d9c57e22aa6ed2"} Jun 02 16:45:19.297699 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.297650 2565 scope.go:117] "RemoveContainer" containerID="970a916d376b37500542bcf4c376553fa9d70d4fc440721987d9c57e22aa6ed2" Jun 02 16:45:19.298557 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.298537 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rwqkt" event={"ID":"2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f","Type":"ContainerStarted","Data":"7ec355efa3b31708c7856083e9ac0df0235ee182e79072dee9690d8352d05e04"} Jun 02 16:45:19.298781 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.298726 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:19.299960 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.299940 2565 generic.go:358] "Generic (PLEG): container finished" podID="5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb" containerID="48d6aada1b709d3257b415fd7589a3b40d277cd55d3a10c5196fc9420f8e63da" exitCode=0 Jun 02 16:45:19.300064 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.300000 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" event={"ID":"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb","Type":"ContainerDied","Data":"48d6aada1b709d3257b415fd7589a3b40d277cd55d3a10c5196fc9420f8e63da"} Jun 02 16:45:19.300258 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.300236 2565 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-rwqkt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.19:8080/\": dial tcp 10.134.0.19:8080: connect: connection refused" start-of-body= Jun 02 16:45:19.300344 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.300284 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-rwqkt" podUID="2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.19:8080/\": dial tcp 10.134.0.19:8080: connect: connection refused" Jun 02 16:45:19.300344 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.300314 2565 scope.go:117] "RemoveContainer" containerID="48d6aada1b709d3257b415fd7589a3b40d277cd55d3a10c5196fc9420f8e63da" Jun 02 16:45:19.348679 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:19.348610 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-rwqkt" podStartSLOduration=1.30603537 podStartE2EDuration="18.348590735s" podCreationTimestamp="2026-06-02 16:45:01 +0000 UTC" firstStartedPulling="2026-06-02 16:45:02.155067028 +0000 UTC m=+222.267620869" lastFinishedPulling="2026-06-02 16:45:19.197622389 +0000 UTC m=+239.310176234" observedRunningTime="2026-06-02 16:45:19.347011905 +0000 UTC m=+239.459565771" watchObservedRunningTime="2026-06-02 16:45:19.348590735 +0000 UTC m=+239.461144600" Jun 02 16:45:20.305614 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:20.305571 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8lvd5" event={"ID":"5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb","Type":"ContainerStarted","Data":"7de1f60eb6e59e479620c2a86e39b713b8f301bd04bbf52312bea841790abe26"} Jun 02 16:45:20.307481 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:20.307416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sltlh" event={"ID":"7e22f70a-683a-4661-9351-beb92358b034","Type":"ContainerStarted","Data":"1bc557d29bd80038edd4fd8be6d298edf584bbcf4b18d17e5be45cbce237a451"} Jun 02 16:45:20.322517 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:20.322486 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-rwqkt" Jun 02 16:45:27.616803 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:27.616766 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:27.617315 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:27.616820 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:32.274971 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.274933 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:45:32.277457 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.277433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eab04f4a-be4a-4535-86d8-aedc1b7ed389-metrics-certs\") pod \"network-metrics-daemon-gzznp\" (UID: \"eab04f4a-be4a-4535-86d8-aedc1b7ed389\") " pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:45:32.295487 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.295449 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:45:32.303677 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.303660 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzznp" Jun 02 16:45:32.445826 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.445694 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzznp"] Jun 02 16:45:32.448307 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:45:32.448277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab04f4a_be4a_4535_86d8_aedc1b7ed389.slice/crio-d6d7a38353380d611683a16c9fe25be7a165b899d787512820f884b5eca63d05 WatchSource:0}: Error finding container d6d7a38353380d611683a16c9fe25be7a165b899d787512820f884b5eca63d05: Status 404 returned error can't find the container with id d6d7a38353380d611683a16c9fe25be7a165b899d787512820f884b5eca63d05 Jun 02 16:45:32.633531 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:32.633452 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" containerID="cri-o://b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8" gracePeriod=30 Jun 02 16:45:33.345079 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:33.344989 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzznp" event={"ID":"eab04f4a-be4a-4535-86d8-aedc1b7ed389","Type":"ContainerStarted","Data":"d6d7a38353380d611683a16c9fe25be7a165b899d787512820f884b5eca63d05"} Jun 02 16:45:34.349897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.349816 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzznp" event={"ID":"eab04f4a-be4a-4535-86d8-aedc1b7ed389","Type":"ContainerStarted","Data":"4ec4c755d5b06b09167387f1d514f7d8ebfde79807b306422e681027fd7b78cb"} Jun 02 16:45:34.349897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.349851 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzznp" event={"ID":"eab04f4a-be4a-4535-86d8-aedc1b7ed389","Type":"ContainerStarted","Data":"504b6242dfc52117aba079be2410ced574ed5cd088633a934ba266a4270b9f97"} Jun 02 16:45:34.351164 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.351142 2565 generic.go:358] "Generic (PLEG): container finished" podID="81d66c7d-2e7e-465c-87e9-a4f441f6b389" containerID="8f975e391946c27234d255acd09c654c9b6488837422abc23ca30d74cfe9bcac" exitCode=0 Jun 02 16:45:34.351267 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.351200 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" event={"ID":"81d66c7d-2e7e-465c-87e9-a4f441f6b389","Type":"ContainerDied","Data":"8f975e391946c27234d255acd09c654c9b6488837422abc23ca30d74cfe9bcac"} Jun 02 16:45:34.351512 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.351490 2565 scope.go:117] "RemoveContainer" containerID="8f975e391946c27234d255acd09c654c9b6488837422abc23ca30d74cfe9bcac" Jun 02 16:45:34.352982 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.352956 2565 generic.go:358] "Generic (PLEG): container finished" podID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerID="b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8" exitCode=0 Jun 02 16:45:34.353299 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.353022 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerDied","Data":"b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8"} Jun 02 16:45:34.353299 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.353046 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerStarted","Data":"e6864a2bb4f34ec035b1ae8d1bfd90493dce4b9e2c74107096372fb480d0cbb3"} Jun 02 16:45:34.353427 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.353410 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:45:34.367812 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:34.367767 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gzznp" podStartSLOduration=252.934291151 podStartE2EDuration="4m14.36773898s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:45:32.450214525 +0000 UTC m=+252.562768369" lastFinishedPulling="2026-06-02 16:45:33.883662351 +0000 UTC m=+253.996216198" observedRunningTime="2026-06-02 16:45:34.366082751 +0000 UTC m=+254.478636615" watchObservedRunningTime="2026-06-02 16:45:34.36773898 +0000 UTC m=+254.480292845" Jun 02 16:45:35.357813 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:35.357777 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-z7rpg" event={"ID":"81d66c7d-2e7e-465c-87e9-a4f441f6b389","Type":"ContainerStarted","Data":"0531b61177f8d7c8fa6d8618d7c9125b8231ff7362ea8fb7a9bf547173550ae6"} Jun 02 16:45:47.611599 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:47.611568 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:47.611982 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:47.611616 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:55.361628 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:55.361593 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:55.362100 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:55.361642 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:45:57.610207 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:57.610168 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:45:57.610647 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:45:57.610233 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:46:01.030967 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:46:01.030926 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6xg92" podUID="a2e4acac-b598-45f8-b0a8-24363746f93c" Jun 02 16:46:01.426047 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:01.425972 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:04.211190 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.211161 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:04.213633 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.213611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2e4acac-b598-45f8-b0a8-24363746f93c-metrics-tls\") pod \"dns-default-6xg92\" (UID: \"a2e4acac-b598-45f8-b0a8-24363746f93c\") " pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:04.311578 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.311542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:46:04.314010 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.313986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7901ac90-e2b8-473b-90bc-d15afdaf039e-cert\") pod \"ingress-canary-bktm2\" (UID: \"7901ac90-e2b8-473b-90bc-d15afdaf039e\") " pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:46:04.431593 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.431562 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:46:04.437315 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.437284 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:04.561716 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.561694 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xg92"] Jun 02 16:46:04.563918 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:46:04.563891 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e4acac_b598_45f8_b0a8_24363746f93c.slice/crio-2eced5a964bcc1bbb809310e7640cb0bfd5378156519011b3074d9bb2a9be967 WatchSource:0}: Error finding container 2eced5a964bcc1bbb809310e7640cb0bfd5378156519011b3074d9bb2a9be967: Status 404 returned error can't find the container with id 2eced5a964bcc1bbb809310e7640cb0bfd5378156519011b3074d9bb2a9be967 Jun 02 16:46:04.595325 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.595301 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:46:04.603593 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.603564 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bktm2" Jun 02 16:46:04.727921 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:04.727898 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bktm2"] Jun 02 16:46:04.730258 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:46:04.730232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7901ac90_e2b8_473b_90bc_d15afdaf039e.slice/crio-d7dbcf4f45a9df6209cc9592cc8f126c561bd5f101db77937f016fc4f2325044 WatchSource:0}: Error finding container d7dbcf4f45a9df6209cc9592cc8f126c561bd5f101db77937f016fc4f2325044: Status 404 returned error can't find the container with id d7dbcf4f45a9df6209cc9592cc8f126c561bd5f101db77937f016fc4f2325044 Jun 02 16:46:05.362689 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:05.362645 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:46:05.363119 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:05.362701 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:46:05.438820 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:05.438777 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xg92" event={"ID":"a2e4acac-b598-45f8-b0a8-24363746f93c","Type":"ContainerStarted","Data":"2eced5a964bcc1bbb809310e7640cb0bfd5378156519011b3074d9bb2a9be967"} Jun 02 16:46:05.440064 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:05.440021 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bktm2" event={"ID":"7901ac90-e2b8-473b-90bc-d15afdaf039e","Type":"ContainerStarted","Data":"d7dbcf4f45a9df6209cc9592cc8f126c561bd5f101db77937f016fc4f2325044"} Jun 02 16:46:06.449714 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:06.449607 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xg92" event={"ID":"a2e4acac-b598-45f8-b0a8-24363746f93c","Type":"ContainerStarted","Data":"e3ca2be0d98adfa91a0f981ed46773b1f077da3c1dd7bc7653f95edcb15c7586"} Jun 02 16:46:06.453302 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:06.453269 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bktm2" event={"ID":"7901ac90-e2b8-473b-90bc-d15afdaf039e","Type":"ContainerStarted","Data":"48a1b4fb9edb7cae007320964e31d51a2d3e8169b99ea141224d10bc945def8b"} Jun 02 16:46:06.490824 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:06.490774 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bktm2" podStartSLOduration=250.919870326 podStartE2EDuration="4m12.490739717s" podCreationTimestamp="2026-06-02 16:41:54 +0000 UTC" firstStartedPulling="2026-06-02 16:46:04.735048128 +0000 UTC m=+284.847601969" lastFinishedPulling="2026-06-02 16:46:06.305917499 +0000 UTC m=+286.418471360" observedRunningTime="2026-06-02 16:46:06.49015034 +0000 UTC m=+286.602704205" watchObservedRunningTime="2026-06-02 16:46:06.490739717 +0000 UTC m=+286.603293610" Jun 02 16:46:07.457542 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.457504 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xg92" event={"ID":"a2e4acac-b598-45f8-b0a8-24363746f93c","Type":"ContainerStarted","Data":"55cb7b713c57351cf0665625f63070bf3bec1ce11459be6368a8b6d7b81047a0"} Jun 02 16:46:07.480020 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.479946 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6xg92" podStartSLOduration=251.743407902 podStartE2EDuration="4m13.479930562s" podCreationTimestamp="2026-06-02 16:41:54 +0000 UTC" firstStartedPulling="2026-06-02 16:46:04.565551638 +0000 UTC m=+284.678105480" lastFinishedPulling="2026-06-02 16:46:06.302074297 +0000 UTC m=+286.414628140" observedRunningTime="2026-06-02 16:46:07.478085237 +0000 UTC m=+287.590639101" watchObservedRunningTime="2026-06-02 16:46:07.479930562 +0000 UTC m=+287.592484425" Jun 02 16:46:07.610877 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.610847 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:46:07.611044 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.610895 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:46:07.611044 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.610933 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:46:07.611359 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.611336 2565 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"e6864a2bb4f34ec035b1ae8d1bfd90493dce4b9e2c74107096372fb480d0cbb3"} pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" containerMessage="Container registry failed liveness probe, will be restarted" Jun 02 16:46:07.614512 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.614488 2565 patch_prober.go:28] interesting pod/image-registry-758ddfcfc5-dsj8j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 16:46:07.614605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:07.614527 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 16:46:08.461181 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:08.461149 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:17.615630 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:17.615601 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:46:18.466008 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:18.465975 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6xg92" Jun 02 16:46:20.414251 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:20.414226 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:46:20.414704 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:20.414389 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:46:20.417347 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:20.417327 2565 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 16:46:32.630710 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:32.630669 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" podUID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerName="registry" containerID="cri-o://e6864a2bb4f34ec035b1ae8d1bfd90493dce4b9e2c74107096372fb480d0cbb3" gracePeriod=30 Jun 02 16:46:33.748377 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:33.748358 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:46:34.530186 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:34.530154 2565 generic.go:358] "Generic (PLEG): container finished" podID="e22a96c1-3332-40c9-b5e5-54e58784c10d" containerID="e6864a2bb4f34ec035b1ae8d1bfd90493dce4b9e2c74107096372fb480d0cbb3" exitCode=0 Jun 02 16:46:34.530390 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:34.530233 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerDied","Data":"e6864a2bb4f34ec035b1ae8d1bfd90493dce4b9e2c74107096372fb480d0cbb3"} Jun 02 16:46:34.530390 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:34.530264 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" event={"ID":"e22a96c1-3332-40c9-b5e5-54e58784c10d","Type":"ContainerStarted","Data":"1896a87b7ab081b824a562bde4c51fe4bc70057eb4d591de3fcf8180df367ee7"} Jun 02 16:46:34.530390 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:34.530279 2565 scope.go:117] "RemoveContainer" containerID="b087b75e3314c33bac8dc67b69f4a492c728c66840298061a8d9c2ba867306f8" Jun 02 16:46:34.530390 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:34.530313 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:46:55.538869 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:46:55.538837 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-758ddfcfc5-dsj8j" Jun 02 16:47:41.069557 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.069522 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-27mkf"] Jun 02 16:47:41.072837 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.072819 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.075898 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.075876 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 16:47:41.079858 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.079605 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-27mkf"] Jun 02 16:47:41.140279 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.140245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-dbus\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.140279 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.140280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-kubelet-config\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.140480 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.140305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1322399c-8c0f-40a4-9f9f-7cea90848f69-original-pull-secret\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.241605 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.241568 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1322399c-8c0f-40a4-9f9f-7cea90848f69-original-pull-secret\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.241740 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.241663 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-dbus\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.241740 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.241695 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-kubelet-config\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.241883 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.241805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-kubelet-config\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.241919 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.241881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1322399c-8c0f-40a4-9f9f-7cea90848f69-dbus\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.243966 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.243937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1322399c-8c0f-40a4-9f9f-7cea90848f69-original-pull-secret\") pod \"global-pull-secret-syncer-27mkf\" (UID: \"1322399c-8c0f-40a4-9f9f-7cea90848f69\") " pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.382383 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.382298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-27mkf" Jun 02 16:47:41.507132 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.507109 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-27mkf"] Jun 02 16:47:41.509704 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:47:41.509677 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1322399c_8c0f_40a4_9f9f_7cea90848f69.slice/crio-e50853cf1394683c46ffbd8270286fb352769bbcb91741d610745c7b0dd119c8 WatchSource:0}: Error finding container e50853cf1394683c46ffbd8270286fb352769bbcb91741d610745c7b0dd119c8: Status 404 returned error can't find the container with id e50853cf1394683c46ffbd8270286fb352769bbcb91741d610745c7b0dd119c8 Jun 02 16:47:41.721395 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:41.721367 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-27mkf" event={"ID":"1322399c-8c0f-40a4-9f9f-7cea90848f69","Type":"ContainerStarted","Data":"e50853cf1394683c46ffbd8270286fb352769bbcb91741d610745c7b0dd119c8"} Jun 02 16:47:46.737343 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:46.737300 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-27mkf" event={"ID":"1322399c-8c0f-40a4-9f9f-7cea90848f69","Type":"ContainerStarted","Data":"d351c1e3feaf00507232d02c3e40454fcf9a5d78b8fc8c3e5464ef0e6e2ed47e"} Jun 02 16:47:46.754366 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:47:46.754319 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-27mkf" podStartSLOduration=1.26081421 podStartE2EDuration="5.754305902s" podCreationTimestamp="2026-06-02 16:47:41 +0000 UTC" firstStartedPulling="2026-06-02 16:47:41.511467676 +0000 UTC m=+381.624021517" lastFinishedPulling="2026-06-02 16:47:46.004959364 +0000 UTC m=+386.117513209" observedRunningTime="2026-06-02 16:47:46.753300365 +0000 UTC m=+386.865854230" watchObservedRunningTime="2026-06-02 16:47:46.754305902 +0000 UTC m=+386.866859766" Jun 02 16:48:41.324819 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.324725 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6wcgd"] Jun 02 16:48:41.326905 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.326885 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.329913 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.329896 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6zx8p\"" Jun 02 16:48:41.330920 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.330901 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 16:48:41.331029 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.330943 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 16:48:41.347668 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.347647 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6wcgd"] Jun 02 16:48:41.410181 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.410140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.410351 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.410191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc6n5\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-kube-api-access-wc6n5\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.511685 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.511626 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.511935 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.511703 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wc6n5\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-kube-api-access-wc6n5\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.521584 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.521553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.521801 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.521780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc6n5\" (UniqueName: \"kubernetes.io/projected/b79e2474-4ba7-4a80-a399-e5991e7e57b4-kube-api-access-wc6n5\") pod \"cert-manager-webhook-587ccfb98-6wcgd\" (UID: \"b79e2474-4ba7-4a80-a399-e5991e7e57b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.649859 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.649761 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:41.777070 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.777014 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-6wcgd"] Jun 02 16:48:41.779818 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:48:41.779781 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb79e2474_4ba7_4a80_a399_e5991e7e57b4.slice/crio-144a09ed0b8f5e3157e592d4ed126bf9589af9c612fe629e6e1466d525fd42e6 WatchSource:0}: Error finding container 144a09ed0b8f5e3157e592d4ed126bf9589af9c612fe629e6e1466d525fd42e6: Status 404 returned error can't find the container with id 144a09ed0b8f5e3157e592d4ed126bf9589af9c612fe629e6e1466d525fd42e6 Jun 02 16:48:41.888040 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:41.888005 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" event={"ID":"b79e2474-4ba7-4a80-a399-e5991e7e57b4","Type":"ContainerStarted","Data":"144a09ed0b8f5e3157e592d4ed126bf9589af9c612fe629e6e1466d525fd42e6"} Jun 02 16:48:45.901891 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:45.901852 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" event={"ID":"b79e2474-4ba7-4a80-a399-e5991e7e57b4","Type":"ContainerStarted","Data":"4b0ca5e2d9d8a76251e83b6b29763ae8d0a07634f2a7ccea594f3ed3ae3003b2"} Jun 02 16:48:45.902273 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:45.901918 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:45.918820 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:45.918740 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" podStartSLOduration=1.023296424 podStartE2EDuration="4.918724493s" podCreationTimestamp="2026-06-02 16:48:41 +0000 UTC" firstStartedPulling="2026-06-02 16:48:41.781516957 +0000 UTC m=+441.894070799" lastFinishedPulling="2026-06-02 16:48:45.676945024 +0000 UTC m=+445.789498868" observedRunningTime="2026-06-02 16:48:45.917872327 +0000 UTC m=+446.030426203" watchObservedRunningTime="2026-06-02 16:48:45.918724493 +0000 UTC m=+446.031278357" Jun 02 16:48:51.907099 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:51.907063 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-6wcgd" Jun 02 16:48:54.267185 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.267143 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-z6j8v"] Jun 02 16:48:54.270734 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.270708 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.273178 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.273158 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-29br7\"" Jun 02 16:48:54.279197 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.279173 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-z6j8v"] Jun 02 16:48:54.310832 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.310806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5qr5\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-kube-api-access-b5qr5\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.310990 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.310847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-bound-sa-token\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.411341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.411300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5qr5\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-kube-api-access-b5qr5\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.411341 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.411347 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-bound-sa-token\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.420515 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.420476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-bound-sa-token\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.420645 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.420556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5qr5\" (UniqueName: \"kubernetes.io/projected/978b38cb-dfff-4b30-b567-1ab9c53e86bf-kube-api-access-b5qr5\") pod \"cert-manager-79c8d999ff-z6j8v\" (UID: \"978b38cb-dfff-4b30-b567-1ab9c53e86bf\") " pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.580320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.580232 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-z6j8v" Jun 02 16:48:54.708200 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.708176 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-z6j8v"] Jun 02 16:48:54.710896 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:48:54.710868 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod978b38cb_dfff_4b30_b567_1ab9c53e86bf.slice/crio-b4b5ce8e217936e59181b375b53641eedf5dd3c851dbcdf8326e1458fd1e6488 WatchSource:0}: Error finding container b4b5ce8e217936e59181b375b53641eedf5dd3c851dbcdf8326e1458fd1e6488: Status 404 returned error can't find the container with id b4b5ce8e217936e59181b375b53641eedf5dd3c851dbcdf8326e1458fd1e6488 Jun 02 16:48:54.927861 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.927763 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-z6j8v" event={"ID":"978b38cb-dfff-4b30-b567-1ab9c53e86bf","Type":"ContainerStarted","Data":"dd3e0ce96b0222bcd7b7a05ecb29ca447e2fd50bcaf36c9641a292729938d21d"} Jun 02 16:48:54.927861 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.927810 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-z6j8v" event={"ID":"978b38cb-dfff-4b30-b567-1ab9c53e86bf","Type":"ContainerStarted","Data":"b4b5ce8e217936e59181b375b53641eedf5dd3c851dbcdf8326e1458fd1e6488"} Jun 02 16:48:54.943764 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:48:54.943708 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-z6j8v" podStartSLOduration=0.943692971 podStartE2EDuration="943.692971ms" podCreationTimestamp="2026-06-02 16:48:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:48:54.943199813 +0000 UTC m=+455.055753680" watchObservedRunningTime="2026-06-02 16:48:54.943692971 +0000 UTC m=+455.056246834" Jun 02 16:49:16.638489 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.638454 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z"] Jun 02 16:49:16.643440 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.643415 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.646506 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.646483 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sbkcv\"" Jun 02 16:49:16.646631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.646507 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 16:49:16.646631 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.646515 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 16:49:16.647578 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.647561 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:49:16.647803 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.647789 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 16:49:16.647887 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.647839 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 16:49:16.651298 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.651280 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z"] Jun 02 16:49:16.793886 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.793852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.794046 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.793912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6xx\" (UniqueName: \"kubernetes.io/projected/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-kube-api-access-ct6xx\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.794046 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.793947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.794046 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.793966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.895087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.895000 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6xx\" (UniqueName: \"kubernetes.io/projected/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-kube-api-access-ct6xx\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.895087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.895039 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.895087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.895057 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.895361 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.895133 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.895782 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.895734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-manager-config\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.897693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.897670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.897802 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.897673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-metrics-cert\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.907546 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.907522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6xx\" (UniqueName: \"kubernetes.io/projected/eccc7b37-bfeb-4a75-90fa-15af7b9abef9-kube-api-access-ct6xx\") pod \"lws-controller-manager-644f4f4cf6-mzd2z\" (UID: \"eccc7b37-bfeb-4a75-90fa-15af7b9abef9\") " pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:16.953682 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:16.953656 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:17.086566 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:17.086541 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z"] Jun 02 16:49:17.088486 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:49:17.088459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccc7b37_bfeb_4a75_90fa_15af7b9abef9.slice/crio-1667893a3be64e74618dae0ab1a8240a925024aeed0ee1629f59f629fdf239fb WatchSource:0}: Error finding container 1667893a3be64e74618dae0ab1a8240a925024aeed0ee1629f59f629fdf239fb: Status 404 returned error can't find the container with id 1667893a3be64e74618dae0ab1a8240a925024aeed0ee1629f59f629fdf239fb Jun 02 16:49:17.990173 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:17.990139 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" event={"ID":"eccc7b37-bfeb-4a75-90fa-15af7b9abef9","Type":"ContainerStarted","Data":"1667893a3be64e74618dae0ab1a8240a925024aeed0ee1629f59f629fdf239fb"} Jun 02 16:49:19.735326 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.735293 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf"] Jun 02 16:49:19.747265 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.747236 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:19.751405 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.751382 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 16:49:19.751559 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.751420 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h4z8v\"" Jun 02 16:49:19.754468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.754227 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 16:49:19.754468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.754293 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 16:49:19.754468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.754368 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 16:49:19.761660 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.761637 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf"] Jun 02 16:49:19.920000 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.919966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:19.920000 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.920003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:19.920192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.920029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:19.920192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.920122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5n9\" (UniqueName: \"kubernetes.io/projected/6572715e-f704-49b8-a8fe-38b2de12304a-kube-api-access-8d5n9\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:19.920192 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:19.920184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021211 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021130 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5n9\" (UniqueName: \"kubernetes.io/projected/6572715e-f704-49b8-a8fe-38b2de12304a-kube-api-access-8d5n9\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021211 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021183 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021437 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021216 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021437 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021234 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021437 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021258 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.021598 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.021581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.023727 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.023690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6572715e-f704-49b8-a8fe-38b2de12304a-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.023888 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.023871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.023932 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.023874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6572715e-f704-49b8-a8fe-38b2de12304a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.030056 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.030033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5n9\" (UniqueName: \"kubernetes.io/projected/6572715e-f704-49b8-a8fe-38b2de12304a-kube-api-access-8d5n9\") pod \"opendatahub-operator-controller-manager-58857ff9f-smmtf\" (UID: \"6572715e-f704-49b8-a8fe-38b2de12304a\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.060166 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.060129 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:20.198441 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:20.198404 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf"] Jun 02 16:49:20.201877 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:49:20.201850 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6572715e_f704_49b8_a8fe_38b2de12304a.slice/crio-2974f0f8ecd85ce2721a0be3e3277d854190d8632a99fc3218b5342f6244ed93 WatchSource:0}: Error finding container 2974f0f8ecd85ce2721a0be3e3277d854190d8632a99fc3218b5342f6244ed93: Status 404 returned error can't find the container with id 2974f0f8ecd85ce2721a0be3e3277d854190d8632a99fc3218b5342f6244ed93 Jun 02 16:49:21.001912 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:21.001873 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" event={"ID":"6572715e-f704-49b8-a8fe-38b2de12304a","Type":"ContainerStarted","Data":"2974f0f8ecd85ce2721a0be3e3277d854190d8632a99fc3218b5342f6244ed93"} Jun 02 16:49:24.012923 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:24.012882 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" event={"ID":"eccc7b37-bfeb-4a75-90fa-15af7b9abef9","Type":"ContainerStarted","Data":"ed061dd2bdbbbd929c5780139088956fce6723f3886afd17cc7d65495b5cc324"} Jun 02 16:49:24.013409 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:24.012977 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:24.014261 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:24.014237 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" event={"ID":"6572715e-f704-49b8-a8fe-38b2de12304a","Type":"ContainerStarted","Data":"cdbe81198a55477765cc1881490f73be4f96be5703806d5701356e93e96c25d7"} Jun 02 16:49:24.050367 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:24.050323 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" podStartSLOduration=1.860139993 podStartE2EDuration="8.050312636s" podCreationTimestamp="2026-06-02 16:49:16 +0000 UTC" firstStartedPulling="2026-06-02 16:49:17.09026846 +0000 UTC m=+477.202822302" lastFinishedPulling="2026-06-02 16:49:23.280441104 +0000 UTC m=+483.392994945" observedRunningTime="2026-06-02 16:49:24.050106439 +0000 UTC m=+484.162660302" watchObservedRunningTime="2026-06-02 16:49:24.050312636 +0000 UTC m=+484.162866499" Jun 02 16:49:25.018895 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:25.018860 2565 generic.go:358] "Generic (PLEG): container finished" podID="6572715e-f704-49b8-a8fe-38b2de12304a" containerID="cdbe81198a55477765cc1881490f73be4f96be5703806d5701356e93e96c25d7" exitCode=0 Jun 02 16:49:25.019301 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:25.018947 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" event={"ID":"6572715e-f704-49b8-a8fe-38b2de12304a","Type":"ContainerDied","Data":"cdbe81198a55477765cc1881490f73be4f96be5703806d5701356e93e96c25d7"} Jun 02 16:49:26.023709 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:26.023673 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" event={"ID":"6572715e-f704-49b8-a8fe-38b2de12304a","Type":"ContainerStarted","Data":"2d58e5c02837e776f7d84653fa051d3a89931d1eb4f2478bee96b73172afc44c"} Jun 02 16:49:26.024115 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:26.023736 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:49:26.046385 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:26.046341 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" podStartSLOduration=1.8608783180000001 podStartE2EDuration="7.046324599s" podCreationTimestamp="2026-06-02 16:49:19 +0000 UTC" firstStartedPulling="2026-06-02 16:49:20.204280446 +0000 UTC m=+480.316834288" lastFinishedPulling="2026-06-02 16:49:25.389726727 +0000 UTC m=+485.502280569" observedRunningTime="2026-06-02 16:49:26.044690177 +0000 UTC m=+486.157244041" watchObservedRunningTime="2026-06-02 16:49:26.046324599 +0000 UTC m=+486.158878464" Jun 02 16:49:35.021519 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:35.021492 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-644f4f4cf6-mzd2z" Jun 02 16:49:37.030023 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:49:37.029992 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-smmtf" Jun 02 16:50:12.875832 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.875737 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt"] Jun 02 16:50:12.879425 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.879407 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.882081 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.882048 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 16:50:12.882210 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.882103 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 16:50:12.882335 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.882312 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pc8cl\"" Jun 02 16:50:12.882464 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.882319 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 16:50:12.894486 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.891435 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt"] Jun 02 16:50:12.969876 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.969833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wts7\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-kube-api-access-7wts7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.969888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.969923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.969941 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.969977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.970003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.970019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970088 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.970041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff956a66-e533-4c56-b164-4cc206b0ab3e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:12.970334 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:12.970083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071252 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071207 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wts7\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-kube-api-access-7wts7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071252 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071254 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071285 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071301 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071319 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071342 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071358 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071478 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff956a66-e533-4c56-b164-4cc206b0ab3e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071800 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071686 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071867 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071867 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071969 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.071969 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.071949 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.072203 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.072180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff956a66-e533-4c56-b164-4cc206b0ab3e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.073927 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.073899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.074057 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.074041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.083118 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.083091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.083359 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.083337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wts7\" (UniqueName: \"kubernetes.io/projected/ff956a66-e533-4c56-b164-4cc206b0ab3e-kube-api-access-7wts7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdknkt\" (UID: \"ff956a66-e533-4c56-b164-4cc206b0ab3e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.191813 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.191706 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:13.326505 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.326479 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt"] Jun 02 16:50:13.329231 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:50:13.329197 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff956a66_e533_4c56_b164_4cc206b0ab3e.slice/crio-8052b6a4555c2e7db3953af18fa31a0b0f7cd8ff7855a13b2261907722f5bafb WatchSource:0}: Error finding container 8052b6a4555c2e7db3953af18fa31a0b0f7cd8ff7855a13b2261907722f5bafb: Status 404 returned error can't find the container with id 8052b6a4555c2e7db3953af18fa31a0b0f7cd8ff7855a13b2261907722f5bafb Jun 02 16:50:13.349821 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.349794 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-97f8n"] Jun 02 16:50:13.354203 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.354183 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.356876 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.356849 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vj58k\"" Jun 02 16:50:13.357004 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.356913 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 16:50:13.360600 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.360581 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-97f8n"] Jun 02 16:50:13.475273 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.475235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2253bda5-7b02-467e-a02b-f05a38eeeb19-redirect-config\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.475457 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.475283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szbll\" (UniqueName: \"kubernetes.io/projected/2253bda5-7b02-467e-a02b-f05a38eeeb19-kube-api-access-szbll\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.576147 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.576112 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szbll\" (UniqueName: \"kubernetes.io/projected/2253bda5-7b02-467e-a02b-f05a38eeeb19-kube-api-access-szbll\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.576320 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.576214 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2253bda5-7b02-467e-a02b-f05a38eeeb19-redirect-config\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.576926 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.576907 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2253bda5-7b02-467e-a02b-f05a38eeeb19-redirect-config\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.584465 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.584443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szbll\" (UniqueName: \"kubernetes.io/projected/2253bda5-7b02-467e-a02b-f05a38eeeb19-kube-api-access-szbll\") pod \"dashboard-redirect-584bd5886b-97f8n\" (UID: \"2253bda5-7b02-467e-a02b-f05a38eeeb19\") " pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.666130 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.666088 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" Jun 02 16:50:13.791507 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:13.791481 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-97f8n"] Jun 02 16:50:13.793901 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:50:13.793878 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2253bda5_7b02_467e_a02b_f05a38eeeb19.slice/crio-44d9325ab29756069491b512af45864a1354b8d447471a3b879b7a2624cda2af WatchSource:0}: Error finding container 44d9325ab29756069491b512af45864a1354b8d447471a3b879b7a2624cda2af: Status 404 returned error can't find the container with id 44d9325ab29756069491b512af45864a1354b8d447471a3b879b7a2624cda2af Jun 02 16:50:14.181072 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:14.180975 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" event={"ID":"ff956a66-e533-4c56-b164-4cc206b0ab3e","Type":"ContainerStarted","Data":"8052b6a4555c2e7db3953af18fa31a0b0f7cd8ff7855a13b2261907722f5bafb"} Jun 02 16:50:14.182098 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:14.182068 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" event={"ID":"2253bda5-7b02-467e-a02b-f05a38eeeb19","Type":"ContainerStarted","Data":"44d9325ab29756069491b512af45864a1354b8d447471a3b879b7a2624cda2af"} Jun 02 16:50:16.673817 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:16.673769 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 02 16:50:16.674157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:16.673869 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 02 16:50:16.674157 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:16.673920 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 02 16:50:17.194434 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:17.194395 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" event={"ID":"ff956a66-e533-4c56-b164-4cc206b0ab3e","Type":"ContainerStarted","Data":"8182f929d9b288b1b294e90c4d602f4cfa882e87b51723e40acc1e789be70890"} Jun 02 16:50:17.195810 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:17.195783 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" event={"ID":"2253bda5-7b02-467e-a02b-f05a38eeeb19","Type":"ContainerStarted","Data":"e01d61d569c829d3b9501b7e7af66a263b0522571c7d020b4fbd46d7781c697e"} Jun 02 16:50:17.217696 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:17.217640 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" podStartSLOduration=1.875277762 podStartE2EDuration="5.217628548s" podCreationTimestamp="2026-06-02 16:50:12 +0000 UTC" firstStartedPulling="2026-06-02 16:50:13.33110985 +0000 UTC m=+533.443663694" lastFinishedPulling="2026-06-02 16:50:16.673460636 +0000 UTC m=+536.786014480" observedRunningTime="2026-06-02 16:50:17.215490945 +0000 UTC m=+537.328044808" watchObservedRunningTime="2026-06-02 16:50:17.217628548 +0000 UTC m=+537.330182411" Jun 02 16:50:17.230405 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:17.230357 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-584bd5886b-97f8n" podStartSLOduration=1.357450598 podStartE2EDuration="4.230344192s" podCreationTimestamp="2026-06-02 16:50:13 +0000 UTC" firstStartedPulling="2026-06-02 16:50:13.795169516 +0000 UTC m=+533.907723358" lastFinishedPulling="2026-06-02 16:50:16.668063097 +0000 UTC m=+536.780616952" observedRunningTime="2026-06-02 16:50:17.229638263 +0000 UTC m=+537.342192141" watchObservedRunningTime="2026-06-02 16:50:17.230344192 +0000 UTC m=+537.342898295" Jun 02 16:50:18.192929 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:18.192882 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:18.198015 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:18.197987 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:18.199574 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:18.199549 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:18.200267 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:18.200246 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdknkt" Jun 02 16:50:41.106726 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.106690 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:41.117809 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.117781 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:41.117981 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.117907 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:41.120799 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.120775 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 16:50:41.120922 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.120822 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 16:50:41.121855 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.121832 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-np8w4\"" Jun 02 16:50:41.206558 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.206520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29qf8\" (UniqueName: \"kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8\") pod \"kuadrant-operator-catalog-8695w\" (UID: \"bc0a687f-da25-43a6-be74-d7e41b6f62d9\") " pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:41.307348 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.307312 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29qf8\" (UniqueName: \"kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8\") pod \"kuadrant-operator-catalog-8695w\" (UID: \"bc0a687f-da25-43a6-be74-d7e41b6f62d9\") " pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:41.315528 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.315500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29qf8\" (UniqueName: \"kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8\") pod \"kuadrant-operator-catalog-8695w\" (UID: \"bc0a687f-da25-43a6-be74-d7e41b6f62d9\") " pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:41.427559 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.427469 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:41.469051 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.469018 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:41.553222 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.553197 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:41.555944 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:50:41.555918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0a687f_da25_43a6_be74_d7e41b6f62d9.slice/crio-4a0a018f04067b1c049fbad3498d69f199e0f20dd4c219f83c5daebc931ff215 WatchSource:0}: Error finding container 4a0a018f04067b1c049fbad3498d69f199e0f20dd4c219f83c5daebc931ff215: Status 404 returned error can't find the container with id 4a0a018f04067b1c049fbad3498d69f199e0f20dd4c219f83c5daebc931ff215 Jun 02 16:50:41.678340 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.678250 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tm6c2"] Jun 02 16:50:41.682693 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.682669 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:41.687812 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.687773 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tm6c2"] Jun 02 16:50:41.811638 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.811599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6g72\" (UniqueName: \"kubernetes.io/projected/80d4a033-bfa1-4a0e-a773-f1a6bc02f087-kube-api-access-v6g72\") pod \"kuadrant-operator-catalog-tm6c2\" (UID: \"80d4a033-bfa1-4a0e-a773-f1a6bc02f087\") " pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:41.912289 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.912256 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6g72\" (UniqueName: \"kubernetes.io/projected/80d4a033-bfa1-4a0e-a773-f1a6bc02f087-kube-api-access-v6g72\") pod \"kuadrant-operator-catalog-tm6c2\" (UID: \"80d4a033-bfa1-4a0e-a773-f1a6bc02f087\") " pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:41.920500 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.920475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6g72\" (UniqueName: \"kubernetes.io/projected/80d4a033-bfa1-4a0e-a773-f1a6bc02f087-kube-api-access-v6g72\") pod \"kuadrant-operator-catalog-tm6c2\" (UID: \"80d4a033-bfa1-4a0e-a773-f1a6bc02f087\") " pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:41.992674 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:41.992646 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:42.130579 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:42.130534 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tm6c2"] Jun 02 16:50:42.160891 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:50:42.160856 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d4a033_bfa1_4a0e_a773_f1a6bc02f087.slice/crio-5614cc39fee30ef979ab91671e013ce7207860c5191f05da533764e60a1c9cea WatchSource:0}: Error finding container 5614cc39fee30ef979ab91671e013ce7207860c5191f05da533764e60a1c9cea: Status 404 returned error can't find the container with id 5614cc39fee30ef979ab91671e013ce7207860c5191f05da533764e60a1c9cea Jun 02 16:50:42.279959 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:42.279875 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8695w" event={"ID":"bc0a687f-da25-43a6-be74-d7e41b6f62d9","Type":"ContainerStarted","Data":"4a0a018f04067b1c049fbad3498d69f199e0f20dd4c219f83c5daebc931ff215"} Jun 02 16:50:42.280900 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:42.280870 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" event={"ID":"80d4a033-bfa1-4a0e-a773-f1a6bc02f087","Type":"ContainerStarted","Data":"5614cc39fee30ef979ab91671e013ce7207860c5191f05da533764e60a1c9cea"} Jun 02 16:50:44.290361 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.290268 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" event={"ID":"80d4a033-bfa1-4a0e-a773-f1a6bc02f087","Type":"ContainerStarted","Data":"a4531b7adcace2c7bcd764791b4251b8885156c5c29c3cc40458974113c335b6"} Jun 02 16:50:44.291600 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.291575 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8695w" event={"ID":"bc0a687f-da25-43a6-be74-d7e41b6f62d9","Type":"ContainerStarted","Data":"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a"} Jun 02 16:50:44.291714 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.291687 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8695w" podUID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" containerName="registry-server" containerID="cri-o://072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a" gracePeriod=2 Jun 02 16:50:44.308211 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.308169 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" podStartSLOduration=1.495326951 podStartE2EDuration="3.308157244s" podCreationTimestamp="2026-06-02 16:50:41 +0000 UTC" firstStartedPulling="2026-06-02 16:50:42.162081207 +0000 UTC m=+562.274635050" lastFinishedPulling="2026-06-02 16:50:43.9749115 +0000 UTC m=+564.087465343" observedRunningTime="2026-06-02 16:50:44.30578557 +0000 UTC m=+564.418339428" watchObservedRunningTime="2026-06-02 16:50:44.308157244 +0000 UTC m=+564.420711137" Jun 02 16:50:44.320810 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.320740 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8695w" podStartSLOduration=0.905910367 podStartE2EDuration="3.320727061s" podCreationTimestamp="2026-06-02 16:50:41 +0000 UTC" firstStartedPulling="2026-06-02 16:50:41.557526909 +0000 UTC m=+561.670080763" lastFinishedPulling="2026-06-02 16:50:43.972343615 +0000 UTC m=+564.084897457" observedRunningTime="2026-06-02 16:50:44.320144795 +0000 UTC m=+564.432698660" watchObservedRunningTime="2026-06-02 16:50:44.320727061 +0000 UTC m=+564.433280925" Jun 02 16:50:44.542196 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.542139 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:44.635906 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.635866 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29qf8\" (UniqueName: \"kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8\") pod \"bc0a687f-da25-43a6-be74-d7e41b6f62d9\" (UID: \"bc0a687f-da25-43a6-be74-d7e41b6f62d9\") " Jun 02 16:50:44.638093 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.638070 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8" (OuterVolumeSpecName: "kube-api-access-29qf8") pod "bc0a687f-da25-43a6-be74-d7e41b6f62d9" (UID: "bc0a687f-da25-43a6-be74-d7e41b6f62d9"). InnerVolumeSpecName "kube-api-access-29qf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:50:44.736639 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:44.736606 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29qf8\" (UniqueName: \"kubernetes.io/projected/bc0a687f-da25-43a6-be74-d7e41b6f62d9-kube-api-access-29qf8\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:50:45.295854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.295740 2565 generic.go:358] "Generic (PLEG): container finished" podID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" containerID="072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a" exitCode=0 Jun 02 16:50:45.295854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.295827 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8695w" Jun 02 16:50:45.296357 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.295827 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8695w" event={"ID":"bc0a687f-da25-43a6-be74-d7e41b6f62d9","Type":"ContainerDied","Data":"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a"} Jun 02 16:50:45.296357 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.295941 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8695w" event={"ID":"bc0a687f-da25-43a6-be74-d7e41b6f62d9","Type":"ContainerDied","Data":"4a0a018f04067b1c049fbad3498d69f199e0f20dd4c219f83c5daebc931ff215"} Jun 02 16:50:45.296357 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.295957 2565 scope.go:117] "RemoveContainer" containerID="072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a" Jun 02 16:50:45.306560 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.306545 2565 scope.go:117] "RemoveContainer" containerID="072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a" Jun 02 16:50:45.306805 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:50:45.306784 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a\": container with ID starting with 072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a not found: ID does not exist" containerID="072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a" Jun 02 16:50:45.306843 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.306816 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a"} err="failed to get container status \"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a\": rpc error: code = NotFound desc = could not find container \"072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a\": container with ID starting with 072bfa29ee5326e40c2cb1f1ab7f4927b729f628a92c09a7fb44e6ab155b702a not found: ID does not exist" Jun 02 16:50:45.317628 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.317605 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:45.321189 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:45.321167 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8695w"] Jun 02 16:50:46.497030 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:46.496998 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" path="/var/lib/kubelet/pods/bc0a687f-da25-43a6-be74-d7e41b6f62d9/volumes" Jun 02 16:50:51.993840 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:51.993803 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:51.994245 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:51.993851 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:52.016173 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:52.016150 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:50:52.347410 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:50:52.347334 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tm6c2" Jun 02 16:51:20.437242 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:20.437215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:51:20.438532 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:20.438514 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:51:23.963434 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.963391 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7"] Jun 02 16:51:23.963854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.963724 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" containerName="registry-server" Jun 02 16:51:23.963854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.963737 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" containerName="registry-server" Jun 02 16:51:23.963854 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.963821 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc0a687f-da25-43a6-be74-d7e41b6f62d9" containerName="registry-server" Jun 02 16:51:23.971500 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.971477 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:23.974413 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.974387 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 16:51:23.974555 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.974483 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q6nq4\"" Jun 02 16:51:23.979817 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:23.979796 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7"] Jun 02 16:51:24.078265 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.078212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgh7q\" (UniqueName: \"kubernetes.io/projected/3a4046b5-3891-4339-aa80-b911eea22531-kube-api-access-pgh7q\") pod \"dns-operator-controller-manager-648d5c98bc-hksd7\" (UID: \"3a4046b5-3891-4339-aa80-b911eea22531\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:24.179144 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.179092 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgh7q\" (UniqueName: \"kubernetes.io/projected/3a4046b5-3891-4339-aa80-b911eea22531-kube-api-access-pgh7q\") pod \"dns-operator-controller-manager-648d5c98bc-hksd7\" (UID: \"3a4046b5-3891-4339-aa80-b911eea22531\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:24.189429 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.189397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgh7q\" (UniqueName: \"kubernetes.io/projected/3a4046b5-3891-4339-aa80-b911eea22531-kube-api-access-pgh7q\") pod \"dns-operator-controller-manager-648d5c98bc-hksd7\" (UID: \"3a4046b5-3891-4339-aa80-b911eea22531\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:24.282520 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.282428 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:24.417414 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.417386 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7"] Jun 02 16:51:24.420088 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:51:24.420058 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4046b5_3891_4339_aa80_b911eea22531.slice/crio-36364ee3f908b12da70b889ad092bdfc36c6663cfa2b875486c8cee8d04a7b1c WatchSource:0}: Error finding container 36364ee3f908b12da70b889ad092bdfc36c6663cfa2b875486c8cee8d04a7b1c: Status 404 returned error can't find the container with id 36364ee3f908b12da70b889ad092bdfc36c6663cfa2b875486c8cee8d04a7b1c Jun 02 16:51:24.434238 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:24.434209 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" event={"ID":"3a4046b5-3891-4339-aa80-b911eea22531","Type":"ContainerStarted","Data":"36364ee3f908b12da70b889ad092bdfc36c6663cfa2b875486c8cee8d04a7b1c"} Jun 02 16:51:27.446958 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:27.446899 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" event={"ID":"3a4046b5-3891-4339-aa80-b911eea22531","Type":"ContainerStarted","Data":"72d8ec84bdd680bf3ffdc7c6a632d98c6fe88f833d35cbcf4d6e1379ed2fa0ab"} Jun 02 16:51:27.447468 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:27.446981 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:27.465635 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:27.465585 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" podStartSLOduration=2.164852139 podStartE2EDuration="4.465570353s" podCreationTimestamp="2026-06-02 16:51:23 +0000 UTC" firstStartedPulling="2026-06-02 16:51:24.424601252 +0000 UTC m=+604.537155094" lastFinishedPulling="2026-06-02 16:51:26.725319465 +0000 UTC m=+606.837873308" observedRunningTime="2026-06-02 16:51:27.46398998 +0000 UTC m=+607.576543845" watchObservedRunningTime="2026-06-02 16:51:27.465570353 +0000 UTC m=+607.578124290" Jun 02 16:51:29.416183 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.416145 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx"] Jun 02 16:51:29.419674 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.419655 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:29.422764 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.422725 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zgnzm\"" Jun 02 16:51:29.431588 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.431563 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx"] Jun 02 16:51:29.526853 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.526812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsdhr\" (UniqueName: \"kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr\") pod \"limitador-operator-controller-manager-85c4996f8c-xscrx\" (UID: \"6c6e6e21-6e08-427e-9f45-54c844db3e26\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:29.627591 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.627550 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdhr\" (UniqueName: \"kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr\") pod \"limitador-operator-controller-manager-85c4996f8c-xscrx\" (UID: \"6c6e6e21-6e08-427e-9f45-54c844db3e26\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:29.644828 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.644793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdhr\" (UniqueName: \"kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr\") pod \"limitador-operator-controller-manager-85c4996f8c-xscrx\" (UID: \"6c6e6e21-6e08-427e-9f45-54c844db3e26\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:29.729474 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.729443 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:29.863972 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:29.863947 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx"] Jun 02 16:51:29.866830 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:51:29.866803 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6e6e21_6e08_427e_9f45_54c844db3e26.slice/crio-9f92ae6e4aafcd6e216b31d6a80c2cb9ca73de54608f670d6d2f91bbae5da3cf WatchSource:0}: Error finding container 9f92ae6e4aafcd6e216b31d6a80c2cb9ca73de54608f670d6d2f91bbae5da3cf: Status 404 returned error can't find the container with id 9f92ae6e4aafcd6e216b31d6a80c2cb9ca73de54608f670d6d2f91bbae5da3cf Jun 02 16:51:30.458662 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:30.458630 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" event={"ID":"6c6e6e21-6e08-427e-9f45-54c844db3e26","Type":"ContainerStarted","Data":"9f92ae6e4aafcd6e216b31d6a80c2cb9ca73de54608f670d6d2f91bbae5da3cf"} Jun 02 16:51:32.466509 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:32.466462 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" event={"ID":"6c6e6e21-6e08-427e-9f45-54c844db3e26","Type":"ContainerStarted","Data":"45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661"} Jun 02 16:51:32.466928 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:32.466556 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:32.490900 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:32.490853 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" podStartSLOduration=1.433860784 podStartE2EDuration="3.490835974s" podCreationTimestamp="2026-06-02 16:51:29 +0000 UTC" firstStartedPulling="2026-06-02 16:51:29.869249244 +0000 UTC m=+609.981803086" lastFinishedPulling="2026-06-02 16:51:31.926224434 +0000 UTC m=+612.038778276" observedRunningTime="2026-06-02 16:51:32.489767268 +0000 UTC m=+612.602321125" watchObservedRunningTime="2026-06-02 16:51:32.490835974 +0000 UTC m=+612.603389878" Jun 02 16:51:38.453424 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:38.453334 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hksd7" Jun 02 16:51:40.289973 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.289936 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4tq5m"] Jun 02 16:51:40.293260 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.293242 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:40.295890 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.295869 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4m2jb\"" Jun 02 16:51:40.302347 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.302324 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4tq5m"] Jun 02 16:51:40.422741 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.422705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bql5s\" (UniqueName: \"kubernetes.io/projected/39f16305-92d2-4a43-b6f2-1bc35a1a87a1-kube-api-access-bql5s\") pod \"authorino-operator-657f44b778-4tq5m\" (UID: \"39f16305-92d2-4a43-b6f2-1bc35a1a87a1\") " pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:40.523280 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.523233 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bql5s\" (UniqueName: \"kubernetes.io/projected/39f16305-92d2-4a43-b6f2-1bc35a1a87a1-kube-api-access-bql5s\") pod \"authorino-operator-657f44b778-4tq5m\" (UID: \"39f16305-92d2-4a43-b6f2-1bc35a1a87a1\") " pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:40.532610 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.532580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bql5s\" (UniqueName: \"kubernetes.io/projected/39f16305-92d2-4a43-b6f2-1bc35a1a87a1-kube-api-access-bql5s\") pod \"authorino-operator-657f44b778-4tq5m\" (UID: \"39f16305-92d2-4a43-b6f2-1bc35a1a87a1\") " pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:40.604200 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.604102 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:40.740244 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.740219 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4tq5m"] Jun 02 16:51:40.743141 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:51:40.743113 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f16305_92d2_4a43_b6f2_1bc35a1a87a1.slice/crio-f53cb700ea9cafdaff09070cd086cecf6cc12e92a76dbeb78df3812ecd5fd31d WatchSource:0}: Error finding container f53cb700ea9cafdaff09070cd086cecf6cc12e92a76dbeb78df3812ecd5fd31d: Status 404 returned error can't find the container with id f53cb700ea9cafdaff09070cd086cecf6cc12e92a76dbeb78df3812ecd5fd31d Jun 02 16:51:40.745114 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:40.745095 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:51:41.506293 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:41.506256 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" event={"ID":"39f16305-92d2-4a43-b6f2-1bc35a1a87a1","Type":"ContainerStarted","Data":"f53cb700ea9cafdaff09070cd086cecf6cc12e92a76dbeb78df3812ecd5fd31d"} Jun 02 16:51:43.472607 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:43.472568 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:43.514785 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:43.514725 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" event={"ID":"39f16305-92d2-4a43-b6f2-1bc35a1a87a1","Type":"ContainerStarted","Data":"9a10e51eae91b41a64831677f8277816cd4da718682a66d95959f6537687d7ed"} Jun 02 16:51:43.514970 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:43.514937 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:54.521403 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:54.521367 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" Jun 02 16:51:54.545590 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:54.545535 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-4tq5m" podStartSLOduration=12.385425502 podStartE2EDuration="14.545518509s" podCreationTimestamp="2026-06-02 16:51:40 +0000 UTC" firstStartedPulling="2026-06-02 16:51:40.745222518 +0000 UTC m=+620.857776361" lastFinishedPulling="2026-06-02 16:51:42.905315521 +0000 UTC m=+623.017869368" observedRunningTime="2026-06-02 16:51:43.539326841 +0000 UTC m=+623.651880704" watchObservedRunningTime="2026-06-02 16:51:54.545518509 +0000 UTC m=+634.658072372" Jun 02 16:51:55.825846 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.825815 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx"] Jun 02 16:51:55.826303 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.826072 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" containerName="manager" containerID="cri-o://45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661" gracePeriod=2 Jun 02 16:51:55.838359 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.838326 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx"] Jun 02 16:51:55.855477 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.855446 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp"] Jun 02 16:51:55.855839 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.855826 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" containerName="manager" Jun 02 16:51:55.855890 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.855841 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" containerName="manager" Jun 02 16:51:55.855924 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.855905 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" containerName="manager" Jun 02 16:51:55.859004 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.858978 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:55.874371 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.874334 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp"] Jun 02 16:51:55.900445 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.900407 2565 status_manager.go:895] "Failed to get status for pod" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" err="pods \"limitador-operator-controller-manager-85c4996f8c-xscrx\" is forbidden: User \"system:node:ip-10-0-131-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-40.ec2.internal' and this object" Jun 02 16:51:55.959862 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:55.959817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p584j\" (UniqueName: \"kubernetes.io/projected/836da19f-ecbd-4a8b-9aa3-3c73809de5b5-kube-api-access-p584j\") pod \"limitador-operator-controller-manager-85c4996f8c-gvxrp\" (UID: \"836da19f-ecbd-4a8b-9aa3-3c73809de5b5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:56.057777 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.057733 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:56.060394 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.060367 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsdhr\" (UniqueName: \"kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr\") pod \"6c6e6e21-6e08-427e-9f45-54c844db3e26\" (UID: \"6c6e6e21-6e08-427e-9f45-54c844db3e26\") " Jun 02 16:51:56.060526 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.060433 2565 status_manager.go:895] "Failed to get status for pod" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" err="pods \"limitador-operator-controller-manager-85c4996f8c-xscrx\" is forbidden: User \"system:node:ip-10-0-131-40.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-40.ec2.internal' and this object" Jun 02 16:51:56.060575 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.060531 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p584j\" (UniqueName: \"kubernetes.io/projected/836da19f-ecbd-4a8b-9aa3-3c73809de5b5-kube-api-access-p584j\") pod \"limitador-operator-controller-manager-85c4996f8c-gvxrp\" (UID: \"836da19f-ecbd-4a8b-9aa3-3c73809de5b5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:56.062787 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.062742 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr" (OuterVolumeSpecName: "kube-api-access-vsdhr") pod "6c6e6e21-6e08-427e-9f45-54c844db3e26" (UID: "6c6e6e21-6e08-427e-9f45-54c844db3e26"). InnerVolumeSpecName "kube-api-access-vsdhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:51:56.069442 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.069413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p584j\" (UniqueName: \"kubernetes.io/projected/836da19f-ecbd-4a8b-9aa3-3c73809de5b5-kube-api-access-p584j\") pod \"limitador-operator-controller-manager-85c4996f8c-gvxrp\" (UID: \"836da19f-ecbd-4a8b-9aa3-3c73809de5b5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:56.166258 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.161701 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsdhr\" (UniqueName: \"kubernetes.io/projected/6c6e6e21-6e08-427e-9f45-54c844db3e26-kube-api-access-vsdhr\") on node \"ip-10-0-131-40.ec2.internal\" DevicePath \"\"" Jun 02 16:51:56.216585 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.216537 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:56.356326 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.356300 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp"] Jun 02 16:51:56.358479 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:51:56.358452 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836da19f_ecbd_4a8b_9aa3_3c73809de5b5.slice/crio-dd8046e291e04d2c8c0771701282f7c7e772552c6c6040a946a4dc1c6557498c WatchSource:0}: Error finding container dd8046e291e04d2c8c0771701282f7c7e772552c6c6040a946a4dc1c6557498c: Status 404 returned error can't find the container with id dd8046e291e04d2c8c0771701282f7c7e772552c6c6040a946a4dc1c6557498c Jun 02 16:51:56.498313 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.498274 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c6e6e21-6e08-427e-9f45-54c844db3e26" path="/var/lib/kubelet/pods/6c6e6e21-6e08-427e-9f45-54c844db3e26/volumes" Jun 02 16:51:56.562768 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.562711 2565 generic.go:358] "Generic (PLEG): container finished" podID="6c6e6e21-6e08-427e-9f45-54c844db3e26" containerID="45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661" exitCode=0 Jun 02 16:51:56.562937 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.562795 2565 scope.go:117] "RemoveContainer" containerID="45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661" Jun 02 16:51:56.562937 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.562802 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xscrx" Jun 02 16:51:56.564516 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.564472 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" event={"ID":"836da19f-ecbd-4a8b-9aa3-3c73809de5b5","Type":"ContainerStarted","Data":"d7d09df1a7777aef799f692480aaab1beca1573fb8947020959ddc8a39693eab"} Jun 02 16:51:56.564516 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.564507 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" event={"ID":"836da19f-ecbd-4a8b-9aa3-3c73809de5b5","Type":"ContainerStarted","Data":"dd8046e291e04d2c8c0771701282f7c7e772552c6c6040a946a4dc1c6557498c"} Jun 02 16:51:56.564704 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.564681 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:51:56.571677 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.571652 2565 scope.go:117] "RemoveContainer" containerID="45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661" Jun 02 16:51:56.571993 ip-10-0-131-40 kubenswrapper[2565]: E0602 16:51:56.571970 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661\": container with ID starting with 45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661 not found: ID does not exist" containerID="45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661" Jun 02 16:51:56.572063 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.572006 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661"} err="failed to get container status \"45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661\": rpc error: code = NotFound desc = could not find container \"45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661\": container with ID starting with 45374e52dc3309de5604cf7ab238f7f470bf9b6238a46129499554f46fd54661 not found: ID does not exist" Jun 02 16:51:56.581092 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:51:56.580968 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" podStartSLOduration=1.580950978 podStartE2EDuration="1.580950978s" podCreationTimestamp="2026-06-02 16:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:51:56.580233455 +0000 UTC m=+636.692787318" watchObservedRunningTime="2026-06-02 16:51:56.580950978 +0000 UTC m=+636.693504843" Jun 02 16:52:07.572106 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:07.572071 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gvxrp" Jun 02 16:52:52.412362 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.412318 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:52:52.415975 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.415951 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.418389 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.418369 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 16:52:52.418486 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.418373 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6g5tq\"" Jun 02 16:52:52.424697 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.424673 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:52:52.438209 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.438182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78e19f7e-a689-4e52-88ee-b116dd75b7e7-config-file\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.438325 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.438284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zts5p\" (UniqueName: \"kubernetes.io/projected/78e19f7e-a689-4e52-88ee-b116dd75b7e7-kube-api-access-zts5p\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.450178 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.450145 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:52:52.538674 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.538630 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78e19f7e-a689-4e52-88ee-b116dd75b7e7-config-file\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.538905 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.538729 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zts5p\" (UniqueName: \"kubernetes.io/projected/78e19f7e-a689-4e52-88ee-b116dd75b7e7-kube-api-access-zts5p\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.539332 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.539310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/78e19f7e-a689-4e52-88ee-b116dd75b7e7-config-file\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.546905 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.546881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zts5p\" (UniqueName: \"kubernetes.io/projected/78e19f7e-a689-4e52-88ee-b116dd75b7e7-kube-api-access-zts5p\") pod \"limitador-limitador-78c99df468-cmpbk\" (UID: \"78e19f7e-a689-4e52-88ee-b116dd75b7e7\") " pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.726903 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.726867 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:52.860596 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:52.860566 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:52:52.863354 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:52:52.863326 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e19f7e_a689_4e52_88ee_b116dd75b7e7.slice/crio-6ae2538df7774edbe8463a530089c1d9fdace68af1f7461b0a78c1e690e94b5a WatchSource:0}: Error finding container 6ae2538df7774edbe8463a530089c1d9fdace68af1f7461b0a78c1e690e94b5a: Status 404 returned error can't find the container with id 6ae2538df7774edbe8463a530089c1d9fdace68af1f7461b0a78c1e690e94b5a Jun 02 16:52:53.766778 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:53.766726 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" event={"ID":"78e19f7e-a689-4e52-88ee-b116dd75b7e7","Type":"ContainerStarted","Data":"6ae2538df7774edbe8463a530089c1d9fdace68af1f7461b0a78c1e690e94b5a"} Jun 02 16:52:55.774953 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:55.774914 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" event={"ID":"78e19f7e-a689-4e52-88ee-b116dd75b7e7","Type":"ContainerStarted","Data":"53d0af1e116f0d45eb9091c721c455c3ef36da8e55021becd49d970422ec8a5a"} Jun 02 16:52:55.775355 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:55.774978 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:52:55.792210 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:52:55.792162 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" podStartSLOduration=1.328693587 podStartE2EDuration="3.792147401s" podCreationTimestamp="2026-06-02 16:52:52 +0000 UTC" firstStartedPulling="2026-06-02 16:52:52.865166285 +0000 UTC m=+692.977720139" lastFinishedPulling="2026-06-02 16:52:55.328620107 +0000 UTC m=+695.441173953" observedRunningTime="2026-06-02 16:52:55.791244447 +0000 UTC m=+695.903798313" watchObservedRunningTime="2026-06-02 16:52:55.792147401 +0000 UTC m=+695.904701330" Jun 02 16:53:06.779633 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:53:06.779558 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-cmpbk" Jun 02 16:54:53.160481 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.160397 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vvrhr"] Jun 02 16:54:53.163690 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.163673 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:53.166401 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.166378 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 16:54:53.174897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.174875 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vvrhr"] Jun 02 16:54:53.254245 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.254213 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:54:53.256882 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.256855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqsd\" (UniqueName: \"kubernetes.io/projected/68e939bc-4b98-4f26-8d7c-fff2a17ac34a-kube-api-access-rnqsd\") pod \"payload-processing-58b6c8fdc7-vvrhr\" (UID: \"68e939bc-4b98-4f26-8d7c-fff2a17ac34a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:53.358054 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.358017 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqsd\" (UniqueName: \"kubernetes.io/projected/68e939bc-4b98-4f26-8d7c-fff2a17ac34a-kube-api-access-rnqsd\") pod \"payload-processing-58b6c8fdc7-vvrhr\" (UID: \"68e939bc-4b98-4f26-8d7c-fff2a17ac34a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:53.366794 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.366773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqsd\" (UniqueName: \"kubernetes.io/projected/68e939bc-4b98-4f26-8d7c-fff2a17ac34a-kube-api-access-rnqsd\") pod \"payload-processing-58b6c8fdc7-vvrhr\" (UID: \"68e939bc-4b98-4f26-8d7c-fff2a17ac34a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:53.474227 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.474194 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:53.602709 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:53.602678 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vvrhr"] Jun 02 16:54:53.605801 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:54:53.605771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e939bc_4b98_4f26_8d7c_fff2a17ac34a.slice/crio-712bccef00b92bff262c5e3fdd4e541db33ae5a5bc354ac81926ae728aead4bc WatchSource:0}: Error finding container 712bccef00b92bff262c5e3fdd4e541db33ae5a5bc354ac81926ae728aead4bc: Status 404 returned error can't find the container with id 712bccef00b92bff262c5e3fdd4e541db33ae5a5bc354ac81926ae728aead4bc Jun 02 16:54:54.194469 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:54.194425 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" event={"ID":"68e939bc-4b98-4f26-8d7c-fff2a17ac34a","Type":"ContainerStarted","Data":"712bccef00b92bff262c5e3fdd4e541db33ae5a5bc354ac81926ae728aead4bc"} Jun 02 16:54:56.204573 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:56.204532 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" event={"ID":"68e939bc-4b98-4f26-8d7c-fff2a17ac34a","Type":"ContainerStarted","Data":"4172be97683586e6972f1d9e4e1bf637c57a985cd33ec7c835ff1d5814d31c22"} Jun 02 16:54:56.205045 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:56.204652 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:54:56.220872 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:54:56.220827 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" podStartSLOduration=1.013426866 podStartE2EDuration="3.220815041s" podCreationTimestamp="2026-06-02 16:54:53 +0000 UTC" firstStartedPulling="2026-06-02 16:54:53.607716787 +0000 UTC m=+813.720270629" lastFinishedPulling="2026-06-02 16:54:55.81510496 +0000 UTC m=+815.927658804" observedRunningTime="2026-06-02 16:54:56.21898727 +0000 UTC m=+816.331541136" watchObservedRunningTime="2026-06-02 16:54:56.220815041 +0000 UTC m=+816.333368902" Jun 02 16:55:07.211136 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:07.211100 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vvrhr" Jun 02 16:55:50.223951 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:50.223913 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:55:57.644226 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.644186 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd"] Jun 02 16:55:57.648740 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.648715 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.652440 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.652410 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 16:55:57.652440 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.652437 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 16:55:57.652640 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.652414 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 16:55:57.652640 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.652412 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gplcp\"" Jun 02 16:55:57.655375 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.655346 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd"] Jun 02 16:55:57.702725 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df284c1-6efb-4c79-9df1-814ca72a5f2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.702933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5kp\" (UniqueName: \"kubernetes.io/projected/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kube-api-access-bj5kp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.702933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.702933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.702933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.702933 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.702896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804361 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df284c1-6efb-4c79-9df1-814ca72a5f2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804569 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804376 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5kp\" (UniqueName: \"kubernetes.io/projected/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kube-api-access-bj5kp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804569 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804397 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804569 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804425 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804569 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804449 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804569 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804830 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804930 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.804991 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.804959 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.806966 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.806936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df284c1-6efb-4c79-9df1-814ca72a5f2b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.807087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.807071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df284c1-6efb-4c79-9df1-814ca72a5f2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.812931 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.812911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5kp\" (UniqueName: \"kubernetes.io/projected/5df284c1-6efb-4c79-9df1-814ca72a5f2b-kube-api-access-bj5kp\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd\" (UID: \"5df284c1-6efb-4c79-9df1-814ca72a5f2b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:57.990537 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:57.990503 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:55:58.096563 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:58.096530 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:55:58.128935 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:58.128904 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd"] Jun 02 16:55:58.131529 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:55:58.131502 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df284c1_6efb_4c79_9df1_814ca72a5f2b.slice/crio-8702f733e7d50807ac0b665e9fe92c89aec71be46f04bc235419a12506323416 WatchSource:0}: Error finding container 8702f733e7d50807ac0b665e9fe92c89aec71be46f04bc235419a12506323416: Status 404 returned error can't find the container with id 8702f733e7d50807ac0b665e9fe92c89aec71be46f04bc235419a12506323416 Jun 02 16:55:58.436384 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:55:58.436296 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" event={"ID":"5df284c1-6efb-4c79-9df1-814ca72a5f2b","Type":"ContainerStarted","Data":"8702f733e7d50807ac0b665e9fe92c89aec71be46f04bc235419a12506323416"} Jun 02 16:56:02.459016 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:02.458977 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" event={"ID":"5df284c1-6efb-4c79-9df1-814ca72a5f2b","Type":"ContainerStarted","Data":"8e3760fff2a134238f4e6b142f370b1d524e62c89dd158bc3b06a30860248a95"} Jun 02 16:56:03.785875 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:03.785793 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:56:09.890347 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:09.890315 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:56:17.991309 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:17.991270 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:56:20.465897 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:20.465860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:56:20.467219 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:20.467196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 16:56:28.563633 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.563599 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq"] Jun 02 16:56:28.567541 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.567514 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.570087 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.570066 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 16:56:28.577033 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.577005 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq"] Jun 02 16:56:28.581575 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.581686 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbqr\" (UniqueName: \"kubernetes.io/projected/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kube-api-access-xvbqr\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.581767 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.581767 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.581889 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.581889 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.581872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682461 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682419 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682648 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682471 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbqr\" (UniqueName: \"kubernetes.io/projected/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kube-api-access-xvbqr\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682648 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682507 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682648 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682525 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682648 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682553 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682648 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682589 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682924 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.682973 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682951 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.683010 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.682975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.685060 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.685038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.685421 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.685401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.690702 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.690684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbqr\" (UniqueName: \"kubernetes.io/projected/691cb5b5-96cd-4eb7-a64a-0b0c2d735c91-kube-api-access-xvbqr\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq\" (UID: \"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:28.877506 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:28.877403 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" Jun 02 16:56:29.014158 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:29.014107 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq"] Jun 02 16:56:29.016542 ip-10-0-131-40 kubenswrapper[2565]: W0602 16:56:29.016511 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691cb5b5_96cd_4eb7_a64a_0b0c2d735c91.slice/crio-53fa744bf81a272b58faf0cd90b4e78f8273658feece2227c0e02419ac2839b9 WatchSource:0}: Error finding container 53fa744bf81a272b58faf0cd90b4e78f8273658feece2227c0e02419ac2839b9: Status 404 returned error can't find the container with id 53fa744bf81a272b58faf0cd90b4e78f8273658feece2227c0e02419ac2839b9 Jun 02 16:56:29.554359 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:29.554314 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" event={"ID":"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91","Type":"ContainerStarted","Data":"32ca9707559b9cc5c37f470459152f42fa0d42c727c89a6ea241cb8489ab88db"} Jun 02 16:56:29.554359 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:29.554354 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq" event={"ID":"691cb5b5-96cd-4eb7-a64a-0b0c2d735c91","Type":"ContainerStarted","Data":"53fa744bf81a272b58faf0cd90b4e78f8273658feece2227c0e02419ac2839b9"} Jun 02 16:56:30.397795 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:56:30.397731 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cmpbk"] Jun 02 16:59:54.276808 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:54.276764 2565 generic.go:358] "Generic (PLEG): container finished" podID="5df284c1-6efb-4c79-9df1-814ca72a5f2b" containerID="8e3760fff2a134238f4e6b142f370b1d524e62c89dd158bc3b06a30860248a95" exitCode=0 Jun 02 16:59:54.277280 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:54.276827 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" event={"ID":"5df284c1-6efb-4c79-9df1-814ca72a5f2b","Type":"ContainerDied","Data":"8e3760fff2a134238f4e6b142f370b1d524e62c89dd158bc3b06a30860248a95"} Jun 02 16:59:54.277448 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:54.277432 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:59:56.286125 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:56.286095 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" event={"ID":"5df284c1-6efb-4c79-9df1-814ca72a5f2b","Type":"ContainerStarted","Data":"c0c67fbaaaee6cdcda647e583bfbe4ff1f26e00dbb86efa34036549bc513ff9a"} Jun 02 16:59:56.305733 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:56.305679 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" podStartSLOduration=1.5155600420000002 podStartE2EDuration="3m59.305663588s" podCreationTimestamp="2026-06-02 16:55:57 +0000 UTC" firstStartedPulling="2026-06-02 16:55:58.13321714 +0000 UTC m=+878.245770985" lastFinishedPulling="2026-06-02 16:59:55.923320688 +0000 UTC m=+1116.035874531" observedRunningTime="2026-06-02 16:59:56.304474781 +0000 UTC m=+1116.417028644" watchObservedRunningTime="2026-06-02 16:59:56.305663588 +0000 UTC m=+1116.418217453" Jun 02 16:59:57.991641 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:57.991548 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:59:57.991641 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:57.991605 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:59:58.004123 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:58.004099 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 16:59:58.304064 ip-10-0-131-40 kubenswrapper[2565]: I0602 16:59:58.303982 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd" Jun 02 17:01:20.497900 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:01:20.497865 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 17:01:20.499595 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:01:20.499575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 17:01:54.200631 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:01:54.200581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-gpfzq_691cb5b5-96cd-4eb7-a64a-0b0c2d735c91/storage-initializer/0.log" Jun 02 17:01:59.531625 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:01:59.531572 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-584bd5886b-97f8n_2253bda5-7b02-467e-a02b-f05a38eeeb19/nginx/0.log" Jun 02 17:02:00.791698 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:00.791670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-smmtf_6572715e-f704-49b8-a8fe-38b2de12304a/copy-manifests/0.log" Jun 02 17:02:00.797794 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:00.797767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-smmtf_6572715e-f704-49b8-a8fe-38b2de12304a/manager/0.log" Jun 02 17:02:02.253562 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:02.253525 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4tq5m_39f16305-92d2-4a43-b6f2-1bc35a1a87a1/manager/0.log" Jun 02 17:02:02.404668 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:02.404642 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hksd7_3a4046b5-3891-4339-aa80-b911eea22531/manager/0.log" Jun 02 17:02:02.637674 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:02.637584 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tm6c2_80d4a033-bfa1-4a0e-a773-f1a6bc02f087/registry-server/0.log" Jun 02 17:02:02.865314 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:02.865279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-cmpbk_78e19f7e-a689-4e52-88ee-b116dd75b7e7/limitador/0.log" Jun 02 17:02:02.985080 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:02.985052 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-gvxrp_836da19f-ecbd-4a8b-9aa3-3c73809de5b5/manager/0.log" Jun 02 17:02:03.389350 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:03.389216 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bdknkt_ff956a66-e533-4c56-b164-4cc206b0ab3e/istio-proxy/0.log" Jun 02 17:02:03.935736 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:03.935680 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vvrhr_68e939bc-4b98-4f26-8d7c-fff2a17ac34a/payload-processing/0.log" Jun 02 17:02:04.526178 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:04.526151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd_5df284c1-6efb-4c79-9df1-814ca72a5f2b/storage-initializer/0.log" Jun 02 17:02:04.534083 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:04.534060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-7v2jd_5df284c1-6efb-4c79-9df1-814ca72a5f2b/main/0.log" Jun 02 17:02:09.333078 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.333044 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ksn2/must-gather-fst4q"] Jun 02 17:02:09.336835 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.336734 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.339872 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.339851 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"openshift-service-ca.crt\"" Jun 02 17:02:09.340950 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.340933 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ksn2\"/\"default-dockercfg-ccmd4\"" Jun 02 17:02:09.341063 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.340934 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"kube-root-ca.crt\"" Jun 02 17:02:09.353964 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.353933 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/must-gather-fst4q"] Jun 02 17:02:09.433703 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.433443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpbd\" (UniqueName: \"kubernetes.io/projected/5e8f335f-d024-4f4b-966b-7dbc2fb209df-kube-api-access-5kpbd\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.433703 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.433527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e8f335f-d024-4f4b-966b-7dbc2fb209df-must-gather-output\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.534255 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.534218 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpbd\" (UniqueName: \"kubernetes.io/projected/5e8f335f-d024-4f4b-966b-7dbc2fb209df-kube-api-access-5kpbd\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.534462 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.534292 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e8f335f-d024-4f4b-966b-7dbc2fb209df-must-gather-output\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.534636 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.534617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5e8f335f-d024-4f4b-966b-7dbc2fb209df-must-gather-output\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.544987 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.544960 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpbd\" (UniqueName: \"kubernetes.io/projected/5e8f335f-d024-4f4b-966b-7dbc2fb209df-kube-api-access-5kpbd\") pod \"must-gather-fst4q\" (UID: \"5e8f335f-d024-4f4b-966b-7dbc2fb209df\") " pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.647592 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.647508 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/must-gather-fst4q" Jun 02 17:02:09.816604 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:09.816569 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/must-gather-fst4q"] Jun 02 17:02:09.818207 ip-10-0-131-40 kubenswrapper[2565]: W0602 17:02:09.818179 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e8f335f_d024_4f4b_966b_7dbc2fb209df.slice/crio-d8f40a7eda0bb64f7a0a19f9d2d7e09103f44f4f4b550f66801df6a3cefec00b WatchSource:0}: Error finding container d8f40a7eda0bb64f7a0a19f9d2d7e09103f44f4f4b550f66801df6a3cefec00b: Status 404 returned error can't find the container with id d8f40a7eda0bb64f7a0a19f9d2d7e09103f44f4f4b550f66801df6a3cefec00b Jun 02 17:02:10.761944 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:10.761908 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/must-gather-fst4q" event={"ID":"5e8f335f-d024-4f4b-966b-7dbc2fb209df","Type":"ContainerStarted","Data":"d8f40a7eda0bb64f7a0a19f9d2d7e09103f44f4f4b550f66801df6a3cefec00b"} Jun 02 17:02:11.769187 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:11.769146 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/must-gather-fst4q" event={"ID":"5e8f335f-d024-4f4b-966b-7dbc2fb209df","Type":"ContainerStarted","Data":"50dce97386f9859f53bfd6a16f57035bfef7e739dd7cc7a947f6c6c72481120e"} Jun 02 17:02:11.769607 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:11.769195 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/must-gather-fst4q" event={"ID":"5e8f335f-d024-4f4b-966b-7dbc2fb209df","Type":"ContainerStarted","Data":"b34197a5620afc47ae5b6ccda0610885c590864ed5063b48c682844e87126388"} Jun 02 17:02:11.786101 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:11.786037 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9ksn2/must-gather-fst4q" podStartSLOduration=1.933397364 podStartE2EDuration="2.786014926s" podCreationTimestamp="2026-06-02 17:02:09 +0000 UTC" firstStartedPulling="2026-06-02 17:02:09.820034557 +0000 UTC m=+1249.932588402" lastFinishedPulling="2026-06-02 17:02:10.672652118 +0000 UTC m=+1250.785205964" observedRunningTime="2026-06-02 17:02:11.78472913 +0000 UTC m=+1251.897282996" watchObservedRunningTime="2026-06-02 17:02:11.786014926 +0000 UTC m=+1251.898568790" Jun 02 17:02:12.916059 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:12.915992 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-27mkf_1322399c-8c0f-40a4-9f9f-7cea90848f69/global-pull-secret-syncer/0.log" Jun 02 17:02:13.079953 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:13.079923 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6n9lj_7f011d3c-60fe-4624-95d0-e650b2d21c3b/konnectivity-agent/0.log" Jun 02 17:02:13.211149 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:13.211121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-40.ec2.internal_750685bd4b4365c66e32e39d3b8c8a62/haproxy/0.log" Jun 02 17:02:17.685164 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:17.685133 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4tq5m_39f16305-92d2-4a43-b6f2-1bc35a1a87a1/manager/0.log" Jun 02 17:02:17.709216 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:17.709149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hksd7_3a4046b5-3891-4339-aa80-b911eea22531/manager/0.log" Jun 02 17:02:17.767240 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:17.767192 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tm6c2_80d4a033-bfa1-4a0e-a773-f1a6bc02f087/registry-server/0.log" Jun 02 17:02:17.830792 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:17.830767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-cmpbk_78e19f7e-a689-4e52-88ee-b116dd75b7e7/limitador/0.log" Jun 02 17:02:17.861662 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:17.861617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-gvxrp_836da19f-ecbd-4a8b-9aa3-3c73809de5b5/manager/0.log" Jun 02 17:02:19.302523 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:19.300137 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-9xhxj_cdd37660-0c52-417b-9a94-deb92a3d9ece/cluster-monitoring-operator/0.log" Jun 02 17:02:19.452771 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:19.452344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-bdh42_2492eefd-d68c-47ca-bd66-36125942988f/monitoring-plugin/0.log" Jun 02 17:02:19.638030 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:19.637947 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj7nk_f74e94d5-2b76-4bed-bb5a-ce819b1b01ca/node-exporter/0.log" Jun 02 17:02:19.658909 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:19.658881 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj7nk_f74e94d5-2b76-4bed-bb5a-ce819b1b01ca/kube-rbac-proxy/0.log" Jun 02 17:02:19.679026 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:19.679001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj7nk_f74e94d5-2b76-4bed-bb5a-ce819b1b01ca/init-textfile/0.log" Jun 02 17:02:20.145693 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.145667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/thanos-query/0.log" Jun 02 17:02:20.169254 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.169230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/kube-rbac-proxy-web/0.log" Jun 02 17:02:20.190991 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.190957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/kube-rbac-proxy/0.log" Jun 02 17:02:20.213553 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.213527 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/prom-label-proxy/0.log" Jun 02 17:02:20.241379 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.241244 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/kube-rbac-proxy-rules/0.log" Jun 02 17:02:20.267738 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:20.267711 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544d55f7c-8mzbb_377e12c2-3b74-4ec7-a64f-d8ea13c8627d/kube-rbac-proxy-metrics/0.log" Jun 02 17:02:22.374517 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:22.374490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-rwqkt_2de7d7d8-5cfb-4a49-a0c9-78b73a01ba8f/download-server/0.log" Jun 02 17:02:22.943482 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:22.943446 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577"] Jun 02 17:02:22.950963 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:22.950938 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:22.958884 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:22.958541 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577"] Jun 02 17:02:23.085580 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.085543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-podres\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.085805 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.085597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-lib-modules\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.085805 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.085701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-sys\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.085805 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.085778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhqm8\" (UniqueName: \"kubernetes.io/projected/f21dac24-b0c6-4291-8c38-a35ebbff28d9-kube-api-access-mhqm8\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.086007 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.085808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-proc\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.186900 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.186852 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-lib-modules\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.186912 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-sys\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.186971 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhqm8\" (UniqueName: \"kubernetes.io/projected/f21dac24-b0c6-4291-8c38-a35ebbff28d9-kube-api-access-mhqm8\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187004 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-proc\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-sys\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187065 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-podres\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187091 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-lib-modules\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187373 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-podres\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.187373 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.187177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f21dac24-b0c6-4291-8c38-a35ebbff28d9-proc\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.196662 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.196590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhqm8\" (UniqueName: \"kubernetes.io/projected/f21dac24-b0c6-4291-8c38-a35ebbff28d9-kube-api-access-mhqm8\") pod \"perf-node-gather-daemonset-m5577\" (UID: \"f21dac24-b0c6-4291-8c38-a35ebbff28d9\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.264907 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.264860 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.437387 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.437348 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577"] Jun 02 17:02:23.763422 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.763352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xg92_a2e4acac-b598-45f8-b0a8-24363746f93c/dns/0.log" Jun 02 17:02:23.784300 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.784269 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xg92_a2e4acac-b598-45f8-b0a8-24363746f93c/kube-rbac-proxy/0.log" Jun 02 17:02:23.827907 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.827875 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" event={"ID":"f21dac24-b0c6-4291-8c38-a35ebbff28d9","Type":"ContainerStarted","Data":"52f97cfbcf2cb03fe9eda54e51e810b67fc97c82a8b0f38bc9ce05e8baaf75b6"} Jun 02 17:02:23.827907 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.827910 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" event={"ID":"f21dac24-b0c6-4291-8c38-a35ebbff28d9","Type":"ContainerStarted","Data":"54a1f3acac9b01dee3cafd5f4a34e7571245a840cea9a4a0ed0c66e00d82c214"} Jun 02 17:02:23.828123 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.827953 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:23.846833 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.846788 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" podStartSLOduration=1.8467304599999999 podStartE2EDuration="1.84673046s" podCreationTimestamp="2026-06-02 17:02:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:02:23.845154114 +0000 UTC m=+1263.957707977" watchObservedRunningTime="2026-06-02 17:02:23.84673046 +0000 UTC m=+1263.959284323" Jun 02 17:02:23.907895 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:23.907859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5ml9_8efbf40f-998c-4cf6-bc40-6708f9ee9823/dns-node-resolver/0.log" Jun 02 17:02:24.366702 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:24.366675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-758ddfcfc5-dsj8j_e22a96c1-3332-40c9-b5e5-54e58784c10d/registry/1.log" Jun 02 17:02:24.370650 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:24.370628 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-758ddfcfc5-dsj8j_e22a96c1-3332-40c9-b5e5-54e58784c10d/registry/2.log" Jun 02 17:02:24.428338 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:24.428312 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wv4p5_4aeaa789-664b-43a5-bd66-6de2a4c12eeb/node-ca/0.log" Jun 02 17:02:25.201717 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:25.201685 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bdknkt_ff956a66-e533-4c56-b164-4cc206b0ab3e/istio-proxy/0.log" Jun 02 17:02:25.371058 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:25.371029 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vvrhr_68e939bc-4b98-4f26-8d7c-fff2a17ac34a/payload-processing/0.log" Jun 02 17:02:25.871917 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:25.871876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bktm2_7901ac90-e2b8-473b-90bc-d15afdaf039e/serve-healthcheck-canary/0.log" Jun 02 17:02:26.336005 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:26.335976 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-8lvd5_5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb/insights-operator/0.log" Jun 02 17:02:26.336764 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:26.336725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-8lvd5_5fd43e3c-ab2e-4d18-bb21-cb6f312ca3cb/insights-operator/1.log" Jun 02 17:02:26.473898 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:26.473868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v48xh_e77ef812-caa3-4bec-a6a5-559ae23c2411/kube-rbac-proxy/0.log" Jun 02 17:02:26.492936 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:26.492902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v48xh_e77ef812-caa3-4bec-a6a5-559ae23c2411/exporter/0.log" Jun 02 17:02:26.513039 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:26.513013 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v48xh_e77ef812-caa3-4bec-a6a5-559ae23c2411/extractor/0.log" Jun 02 17:02:28.582258 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:28.582229 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-584bd5886b-97f8n_2253bda5-7b02-467e-a02b-f05a38eeeb19/nginx/0.log" Jun 02 17:02:29.035076 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:29.035047 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-smmtf_6572715e-f704-49b8-a8fe-38b2de12304a/manager/0.log" Jun 02 17:02:29.058392 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:29.058361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-smmtf_6572715e-f704-49b8-a8fe-38b2de12304a/copy-manifests/0.log" Jun 02 17:02:29.843730 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:29.843702 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-m5577" Jun 02 17:02:30.358309 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:30.358281 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-644f4f4cf6-mzd2z_eccc7b37-bfeb-4a75-90fa-15af7b9abef9/manager/0.log" Jun 02 17:02:35.028022 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:35.027982 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-69t5n_b0e0701d-13cd-4fed-ade1-63c48d42bc00/migrator/0.log" Jun 02 17:02:35.051190 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:35.049044 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-69t5n_b0e0701d-13cd-4fed-ade1-63c48d42bc00/graceful-termination/0.log" Jun 02 17:02:35.377957 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:35.377874 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sltlh_7e22f70a-683a-4661-9351-beb92358b034/kube-storage-version-migrator-operator/1.log" Jun 02 17:02:35.378762 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:35.378726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sltlh_7e22f70a-683a-4661-9351-beb92358b034/kube-storage-version-migrator-operator/0.log" Jun 02 17:02:36.440358 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.440326 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2rlsk_3f84be35-645d-4f91-9e1b-fcba46088cef/kube-multus/0.log" Jun 02 17:02:36.464942 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.464915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/kube-multus-additional-cni-plugins/0.log" Jun 02 17:02:36.484701 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.484672 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/egress-router-binary-copy/0.log" Jun 02 17:02:36.505764 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.505721 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/cni-plugins/0.log" Jun 02 17:02:36.524407 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.524386 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/bond-cni-plugin/0.log" Jun 02 17:02:36.545193 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.545161 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/routeoverride-cni/0.log" Jun 02 17:02:36.567065 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.567034 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/whereabouts-cni-bincopy/0.log" Jun 02 17:02:36.585735 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.585710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87l8s_f93a7d2d-ca4c-4224-a13c-4935ccd7cfc1/whereabouts-cni/0.log" Jun 02 17:02:36.984584 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:36.984560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzznp_eab04f4a-be4a-4535-86d8-aedc1b7ed389/network-metrics-daemon/0.log" Jun 02 17:02:37.005796 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:37.005769 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzznp_eab04f4a-be4a-4535-86d8-aedc1b7ed389/kube-rbac-proxy/0.log" Jun 02 17:02:38.426225 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.426200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-controller/0.log" Jun 02 17:02:38.445840 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.445816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/0.log" Jun 02 17:02:38.452053 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.452031 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovn-acl-logging/1.log" Jun 02 17:02:38.471397 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.471369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/kube-rbac-proxy-node/0.log" Jun 02 17:02:38.490249 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.490221 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 17:02:38.506575 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.506554 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/northd/0.log" Jun 02 17:02:38.524723 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.524704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/nbdb/0.log" Jun 02 17:02:38.544515 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.544494 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/sbdb/0.log" Jun 02 17:02:38.650169 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:38.650138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l7zkw_a9c9b1e4-5048-4040-91cb-034f0ec7f3b9/ovnkube-controller/0.log" Jun 02 17:02:39.770731 ip-10-0-131-40 kubenswrapper[2565]: I0602 17:02:39.770703 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qrg4v_baa3e27a-33cf-4568-a628-6d1b7c5132e1/network-check-target-container/0.log"